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Description 

[0001 ] The present invention relates to a behavior de- 
termining apparatus for determining whether or not a 
pattern regarding behaviors of a given subject person 
and an actual behavior of that person are substantially 
identical; a behavior determining apparatus for deter- 
mining whether or not the pattern of actions of a given 
device and an actual action of that device are substan- 
tially identical; a care system for accurately specifying 
the behavior of a subject person and taking care of that 
person; a care residence equipped with that care sys- 
tem; a measuring method, pertaining to the measure- 
ment of actions and behaviors in varying states of hu- 
mans, animals, machines or the like, for measuring 
those actions and behaviors; an apparatus using that 
method; and a system including that apparatus. 
[0002] Behavior determining apparatuses according 
to the prior art include, for instance, an apparatus for 
determining the behaviors of seniorcitizens living alone. 
To cite a specific example, there is an apparatus that 
keeps on recording for a month or any other prescribed 
period how many times, both cumulatively and per unit 
length of time, the "pour 11 button of an automatic thermos 
used in the residence of a senior citizen living alone is 
pressed; records the average daily frequency of button 
pressing as the pattern of the resident's use of the ther- 
mos; and, after these preliminary steps, detects his or 
her actions to pour hot water from the thermos; com- 
pares the frequency of the actions with the recorded pat- 
tern to determine whether or not the actual frequency is 
substantially identical with the pattern observed in ad- 
vance. The apparatus determines the senior citizen's 
behaviors and, if for instance he or she does not use the 
thermos when its use is expected according to the pat- 
tern observed in advance, issues to a management 
center, which is connected to the behavior determining 
apparatus, an alarm that he or she may be ill. Another 
behavior determining apparatus according to the prior 
art, as the foregoing apparatus compares the actual use 
of the thermos with the pattern observed in advance, 
detects the use of city water with a sensor fitted to the 
water discharge meter and determines the behaviors of 
the senior citizen living alone by comparing the detected 
act of actual water consumption and a pattern observed 
in advance and determining whether or not the detected 
act and the pre-observed pattern are substantially iden- 
tical. 

[0003] Furthermore, based on a similar principle to 
the idea underlying the apparatuses which compare and 
determine the presence or absence of substantial iden- 
tity between the actions of a device, such as an auto- 
matic thermos, and the pre-observed pattern of its use, 
another behavior determining apparatus directly detects 
human behaviors, instead of the actions of a device, and 
determines whether or not the subject person's behav- 
iors are substantially identical with a pre-recorded pat- 
tern of his or her behaviors. The means of directly de- 
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tecting the person's behavior may be, for instance, a py- 
ro-electric type infrared ray sensor installed on the ceil- 
ing of a room or a passage the person frequently pass- 
es. If the sensor detects his or her passage frequently 
5 enough, the person can be assumed to be living without 
trouble. 

[0004] In recent years, with the aging of the national 
population, care of senior citizens has become a matter 
of grave social concern, with particular emphasis on 

10 those suffering from senile dementia or manifesting 
wandering symptoms, and the above-described and 
various other techniques have been proposed to ad- 
dress this issue. It is considered very useful in taking 
care of these senior citizens to have some means for 

15 keeping track of the behaviors of each and, if anything 
wrong is found, notifying the person concerned and 
someone else responsible for his or her care. Apart from 
senior citizens, if, for instance, behavioral patterns are 
specified by measuring and analyzing human behav- 

20 iors, it will become possible to control illumination, air 
conditioning and so forth and thereby to make their op- 
eration more pleasant and safer for residents. 
[0005] Furthermore, the effectiveness of measure- 
ment is not limited to human behaviors, but the behav- 

25 iors of animals or machines can also be measured use- 
fully. It could help reveal some unknown ecological as- 
pects of animals, or measurement of states and actions 
of machines could contribute to their more efficient and 
safer operation and accordingly to greater efficiency of 

30 productive activities as a whole. 

[0006] In understanding the behaviors of a human 
body or a inanimate object, it is essential to determine 
"who (or what)" does "what" and "where," because the 
individual or the object should be specified, its position 

35 in the room pinpointed, and its action and attitude de- 
tected. 

[0007] An individual or a specific object may be spec- 
ified by RF-ID or visual perception of CCD images. The 
RF-ID is a system whereby specifying information from 

40 a tag (also called a transponder; hereinafter to be re- 
ferred to as a tag throughout) fitted to a moving body 
such as a human body or an inanimate one is received- 
by an antenna (also calleda reader; hereinafter to be re- 
ferred to as an antenna throughout) as an electric wave 

45 of a specific frequency, and the object is thereby spec- 
ified automatically. 

[0008] This system can be broadly classified into two 
types by the reach of tag reading. One is a short-range 
type using a low frequency, for which the distance be- 
so tween the tag and the antenna is around 50 cm or less. 
The usual way of using this type is to hold the tag closely 
over the antenna or to sew the tag into a cuff of the 
slacks so that information from the tag can be read by 
an antenna installed on the floor. The other is a long- 
55 range type using a microwave, for which the distance 
between the tag and the antenna is more than 1 m. In 
this arrangement, the tag is mounted on a part of the 
human body or the object, and when the bearer of the 
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tag passes near the antenna, information from the tag 
can be read by the antenna without being noticed by the 
bearer of the tag. 

[0009] On the other hand, by the method of visual per- 
ception of CCD images, a CCD camera shoots a human 
or an inanimate body passing an entrance/exit, extracts 
characteristic quantities such as the personal face or the 
shape of or any mark on the object by visual perception 
and, by comparing them with inherent characteristic 
quantities registered in advance, the person or the spe- 
cific object is specified. 

[001 0] Methods for specifying the position of a human 
or an inanimate body indoors include extraction from 
CCD images and extracting from temperature distribu- 
tion information obtained with a two-dimensional infra- 
red sensor. A method proposed for use in a very large 
building is to determine an approximate position from 
the intensities of electric waves from a plurality of base 
stations, using the personal handyphone system (PHS). 
[001 1 ] Older methods proposed for detecting actions 
and/or attitudes include ones by which a static condition 
and a dynamic condition are distinguished from each 
other by using a passometer, a mercury switch or the 
like. Recently proposed methods include, as various ac- 
celeration sensors and gyro sensors (angular accelera- 
tion sensors) have been improved in performance, ones 
based on the detection of the walking condition, the in- 
clination of the body, the walking direction and/or other 
factors using these improved sensors. 

BRIEF SUMMARY OF THE INVENTION 

Object of the Invention 

[0012] However, since conventional behavior deter- 
mining apparatuses relying on the actions of an auto- 
matic thermos or a water discharge meter can hardly 
keep track of everyday life activities of the subject per- 
son on a real time basis. Therefore, even if something 
wrong occurs with the subject person, it will take some 
time, a full day for instance, until that unusual state is 
specified as such. 

[0013] Furthermore, because a pyro-electric infrared 
ray sensor would react to, for instance, the fluttering of 
a curtain when the window is opened or the movement 
of a small pet animal, such as a dog or a cat, a conven- 
tional behavior determining apparatus using this kind of 
sensor cannot accurately detect human behaviors ei- 
ther. 

[001 4] Furthermore, there is another means for direct- 
ly detecting human behaviors than the pyro-electric in- 
frared ray sensor, known as an in-bed state sensor, 
which detects whether or not the subject person is in 
bed. For instance, if the subject person gets up in the 
middle of night, goes to the kitchen and toilet and returns 
to the bed, a pyro-electric infrared ray sensor and/or an 
in-bed state sensor can detect that he or she once left 
the bed late at night, went to the kitchen and toilet and 
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returned to the bed. However, the conventional behavior 
determining apparatus cannot tell whether the person 
felt thirsty, went to the kitchen, opened the refrigerator 
door, drank something and then went to the toilet or left 

5 the bed and went to the kitchen and the toilet all with no 
conscious purpose. If, for instance, a senior person be- 
haves meaninglessly, he or she may be suffering from 
senile dementia, but the conventional behavior deter- 
mining apparatus cannot be used for detecting a symp- 

10 torn of senile dementia. 

[0015] The present invention, in view of the above- 
noted problems, is intended to provide a behavior de- 
termining apparatus for detecting the behaviors of the 
subject person more accurately. 

15 [0016] Also, the invention is also intended to accu- 
rately specify the behaviors of the subject person and 
provide a care system for taking care of the subject per- 
son on that basis. The invention is further intended to 
provide a care residence equipped with that care sys- 

20 tern. 

[001 7] Also, the above-described behavior determin- 
ing apparatus according to the prior art issues an alarm 
when any actual action of the subject device and a pre- 
recorded pattern are not identical with each other within 

25 a prescribed period of time or within a prescribed range 
of action variations, or when any actual behavior of the 
subject person and a pre-recorded pattern are not iden- 
tical with each other within a prescribed period of time 
or within a prescribed range of behavior variations. 

30 Therefore if, for instance, the customary hours of the 
subject person's visit to a hospital have changed and, 
when he or she is supposed to be in bed according to 
the pre-recorded pattern, the subject person is cooking 
in the kitchen, the differences from the person's behav- 

35 iors and the device's recorded pattern will actuate an 
alarm to the subject person. 

[001 8] The subject person can stop the alarm issued 
to him but cannot respond to it in any other way. More 
specifically, after the alarm, the person cannot add to 

40 the records in the behavior determining apparatus the 
behavior or action regarding which the alarm was issued 
as a new element of pattern, or replace the existing per- 
tinent pattern with the new one. 
[0019] The present invention, with these problems 

45 taken into account, is intended to provide a behavior de- 
termining apparatus for notifying, if any behavior of the 
subject person or any action of the subject device is not 
substantially identical with a pre-recorded pattern, that 
non-identity and permitting the inputting of a response 

so to that notification. 

[0020] The invention is further intended to provide a 
behavior determining apparatus for adding, on the basis 
of the response from the notification, the behavior of the 
subject person or the action of the subject device not 

55 substantially identical with the pre-recorded pattern to 
the records as a new element of pattern, or replacing all 
or part of the recorded pattern with a new pattern or a 
new element of pattern. 
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[0021] In addition, the invention is intended to provide 
a care system for accurately specifying any behavior of 
the subject person, accurately notifying the behavior, 
permitting the inputting of the person's response to the 
notification, and providing care to the person on the ba- 
sis of that response. The invention is further intended to 
provide a care residence equipped with the care system. 
[0022] Although many methods have been proposed 
for the purpose of detecting "who (or what)" does "what" 
and "where" as described above, none of them can per- 
form any more than a single function. In other words, 
none of them can determine in an integrated way "who 
(or what)" does "what" and "where." Although RF-ID can 
specify a specific person or an inanimate object entering 
a room, if a plurality of persons enter a room, it will be 
impossible to determine "who (or what)" is "where" by a 
method for locating the position of a person or an inan- 
imate object. An acceleration sensor may be able to de- 
tect, for instance, the attitude of the subject, but not the 
position in which the attitude is taken. 
[0023] The above-described methods involve a 
number of additional problems. Regarding RF-ID cited 
as a method for specifying an individual person or a spe- 
cific inanimate object, the short-range type requires, be- 
cause of the short distance of communication between 
the tag and the antenna, the tag to be consciously held 
closely over the antenna. The long-range type, on the 
other hand, because of its long distance of communica- 
tion between the tag and the antenna, may sense not 
only passage through the entrance/exit but also pas- 
sage beside the antenna by the person who does not 
actually enter the room. Specification of an individual 
person or a specific inanimate object from a CCD image, 
because of the need to extract characteristic quantities 
from the image, involves the problem of impossibility to 
specify the person if his or her face is made invisible by 
an obstacle in-between or by the darkness of night. 
[0024] The present invention, with these problems 
taken into account, is intended to provide a behavior 
measuring method, apparatus and system capable of 
acquiring in a composite way the aforementioned be- 
havioral information on "who" does "what" and "where" 
and acquiring readily and accurately behavioral infor- 
mation adaptable to many different applications by ac- 
curately keeping track of the entrance into or the exit 
from a room by a human body or an inanimate body, 
specifying the person or the object at that point of time, 
and detecting the position and attitude of that human 
body or the inanimate object on that basis. 
[0025] GB-A-2 1 79 1 86 describes an apparatus allow- 
ing to detect the movement of a person and by employ- 
ing timing means, to initiate an alarm as soon as no 
movement is detected for a predetermined period of 
time. 

[0026] A networked health care and monitoring sys- 
tem is described in EP-A-0 558 975. The described 
health care and monitoring system allows to measure 
vital data such as heart beat rate or a body temperature 



when a person is performing a routine living activity, for 
instance, bathing or a body care. The obtained health 
information is stored and transferred to a medical care 
station for health monitoring. 

5 [0027] WO-A-93/16636 describes a monitoring de- 
vice for monitoring a physical condition of a subject per- 
son. The device includes a wrist-held detector and a ra- 
dio transmitter to send alarm messages. The detector 
measures vital parameters on a person and checks for 

io abnormal values of the measured parameters. Thus, as 
soon as an abnormal state is detected, an alarm is sent 
via radio wave to a receiving station. 
[0028] It is the object of the present invention to pro- 
vide an improved behaviour determining apparatus and 

is behaviour determining method. 

[0029] This is achieved by the features of the inde- 
pendent claims. 

[0030] Preferably, to solve the above problems, the 
entrance/exit of a human body or a lifeless body into/out 

20 of the room is accurately grasped by means for detect- 
ing the moving direction and at this point, each individual 
person or thing is specified by using the RF-ID. By ac- 
curately measuring the timing of room entrance/exit, the 
trouble of holding a tag over the antenna is solved which 

25 has so far been a problem in a short-range type RF-ID 
and an erroneous judgement made in case of a human 
body or a lifeless body passing by the antenna without 
entering the room can be also solved which has been a 
problem in a long-range type RF-ID. 

30 [0031] Besides, since a specific human body or life- 
less body entering the room once can be grasped as 
mentioned above, the position, the posture or the like of 
the specific human body or lifeless body can be detect- 
ed/grasped. By means of a sensor fitted to part of a hu- 

35 man body or lifeless body, for example, his or her pos- 
ture is detected and the information about a human body 
or a lifeless body present in the adjacent room is also 
received by the base station in the exchange of the pos- 
ture information with the base station. Since the human 

40 body or lifeless body present in this room is specified 
beforehand, however, the information about the human 
body or lifeless body present in this room can be clearly 
distinguished from the information about the human 
body or lifeless body present in the adjacent room. 

45 [0032] A behavioral information specifying apparatus 
according to the present invention, comprising an RF-ID 
and means provided at the doorway of a room for de- 
tecting the moving direction, one or more position de- 
tective means, the above RF-ID, means for detecting 

50 the moving direction and sensor signal processing 
means for evaluating the behavioral information from 
the position detective means provided in the room, is 
featured by allowing a human or lifeless body to bear 
means for determining the status of the human or life- 

55 less body. 

[0033] The above configuration makes it possible, ac- 
cording to the present invention, to specify a human or 
lifeless body entering the room and to accurately meas- 
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ure individual behavioral information items such as po- 
sition in the room, posture and physiological state by 
means of a behavioral information specifying apparatus. 
[0034] Besides, by communicating with the base sta- 
tion wirelessly and further connecting the base station 
to network stations, status determining means fitted to 
a human or lifeless body can manage the behavioral in- 
formation of human or lifeless bodies in rooms and in a 
specific space altogether and can grasp the behavior of 
human or lifeless bodies in the whole building at the real 
time, while innumerable applications such as detection 
of abnormalities, control of air conditioning/illumination 
and security are thinkable. 

FIG. 1 is a drawing for explaining the location of 
each component unit when the several component 
units configuring the behavior determining appara- 
tus of embodiment 1 of the present invention are 
installed in various locations in a residence, etc; 
FIG. 2 is a block diagram of the behavior determin- 
ing apparatus of embodiment 1 of the present in- 
vention; 

FIG. 3 is a drawing showing part of pattern 1 record- 
ed in recording unit 23 of the behavior determining 
apparatus of embodiment 1 of the present inven- 
tion; 

FIG. 4 is a drawing showing part of pattern 2 record- 
ed in the recording unit 23 of the behavior determin- 
ing apparatus of embodiment 1 of the present in- 
vention; 

FIG. 5 is a flowchart showing the operation of the 
determining unit 24 of the behavior determining ap- 
paratus of embodiment 1 of the present invention; 
FIG. 6 is a block diagram of the care system of em- 
bodiment 2; 

FIG. 7 is a drawing for explaining the location of 
each component unit when the several component 
units configuring the behavior determining appara- 
tus of embodiment 3 are installed in various loca- 
tions in a residence, etc; 

FIG. 8 is a block diagram of the behavior determin- 
ing apparatus of embodiment 3; 
FIG. 9 is a drawing showing part of pattern 1 record- 
ed in the first recording unit 123 of the behavior de- 
termining apparatus of embodiment 3; 
. FIG. 1 0 is a drawing showing part of pattern 2 re- 
corded in the first recording unit 1 23 of the behavior 
determining apparatus of embodiment 3; 
FIG. 11 is a flowchart showing the operation of the 
behavior determining apparatus of embodiment 3; 
FIG. 1 2 is a block diagram of the behavior determin- 
ing apparatus of embodiment 4; 
FIG. 13 is a drawing showing part of a pattern re- 
corded in the first recording unit 1 30 of the behavior 
determining apparatus of embodiment 4; 
FIG. 14 is a block diagram of the care system of 
embodiment 5; 

FIG. 15 is an outline type drawing of the behavior 
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information specifying apparatus in embodiment 6; 
FIG. 16 is an outline type drawing of the behavior 
information specifying apparatus in embodiment 7; 
FIG. 17 is a drawing showing the ID specification 
5 procedure using the moving direction detector in 
embodiment 7; 

FIG. 18 is a drawing showing the installation posi- 
tion and detection area of the moving direction de- 
tector in the behavior information specifying appa- 
10 ratus in embodiment 8; 

FIG. 19 shows an example of movement detection 
by the moving direction detector in embodiment 8; 
FIG. 20 shows an outline type drawing of the be- 
havior information specifying apparatus in embodi- 
es ment 9; 

FIG. 21 shows a measurement example regarding 
the human body position specification method in 
embodiment 10; 

FIG. 22 shows a measurement example regarding 
20 the human body position specification method in 
embodiment 10; 

FIG. 23 shows outline type drawings relating to po- 
sition specifying unit using a two-dimensional infra- 
red ray sensor in the behavior information specify- 
25 ing apparatus in embodiment 1 1 ; 

FIG. 24 shows an outline type drawing of the be- 
havior information specifying apparatus in embodi- 
ment 12; 

FIG. 25 shows an outline type drawing of the be- 
so havior information specifying apparatus in embodi- 
ment 13; 

FIG. 26 shows an outline type drawing of the state 
specifying unitin embodiment 15; 
FIG. 27 is an outline type drawing of the behavior 
35 information specifying apparatus in embodiment 
16; and 

FIG. 28 is an outline type drawing of the behavior 
information specifying apparatus in embodiment 
16. 

40 

(Embodiment 1) 

[0035] First, a configuration of a behavior determining 
apparatus according to Embodiment 1 will be described 

« referring to FIGS. 1 and 2. 

[0036] FIG. 1 is an illustration of the disposed posi- 
tions of individual constituent means in the case where 
individual constituent means of a behavior determining 
apparatus according to Embodiment 1 of the present in- 

so vention are disposed at the respective positions of a res- 
idence. FIG. 2 is a block diagram of a behavior deter- 
mining apparatus according to Embodiment 1 of the 
present invention. 

[0037] As shown in FIG. 1 , a behavior determining ap- 
55 paratus according to Embodiment 1 of the present in- 
vention comprises CCD cameras 1a and 1b, an I R sen- 
sor 2, an in-bed/out-of-bed sensor 3, an air-quality sen- 
sor 4, a toilet sensor 5, window Open/Close detective 
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means 6 and 7, TV power source ON/OFF detective 
means 8, refrigerator door Open/Close detective means 
9, management unit 10, a PIT 11, transmitter/receiver 
unit 12 and a loudspeaker 13. 
[0038] The CCD camera 1 a is means, installed on the 
ceiling of a kitchen 1 4 at the first floor of a residence, for 
photographing the space look of the kitchen 14, where- 
as the CCD camera 1 b is means, installed on the ceiling 
of a living room 15 at the first floor, for photographing 
the space look of the living room 1 5. The IR sensor 2 is 
means, installed on the ceiling at the position of the door 
separating the kitchen 14 and the living room 15 from 
each other, for detecting the move of a human body from 
one to another of the kitchen 14 and the living room 15. 
The in-bed/out-of-bed sensor 3 is means, installed be- 
tween the stay of a bed 1 7 disposed in a bedroom 1 6 of 
the second floor and the floor on which the bed 17 is 
placed, for detecting whether a person is present in the 
bed 1 7 by detecting the load weight imposed on the bed 
17. The air-quality sensor 4 is means, installed on the 
ceiling of the kitchen 1 4, for measuring the humidity and 
the concentration of volatile organic substances and 
C0 2 in the kitchen room and thetoilet sensor 5 is means, 
installed on the ceiling of a toilet 1 8, for detecting a rough 
position and time of a person entering the toilet 18 by 
using an IR long-range sensor. 
[0039] The window Open/Close detective means 6 is 
means, installed on the window 1 9 provided in the bed- 
room 16, for detecting whether the window 19 is Open 
or Close. Similarly, the window Open/Close detective 
means 7 is means for detecting whether the window 20 
provided in the living room 1 5 is Open or Close. The TV 
power supply ON/OFF detective means 8 is means for 
detecting whether the power supply of the TV set 21 pro- 
vided in the living room 1 5 is ON or OFF wherein power 
supply ON/OFF of the TV set 21 is detected using a 
greater current quantity for ON than for O FF or discern- 
ing whether the TV set 21 caught a remote control switch 
signal or not. The refrigerator door Open/Close detec- 
tive means 9 is means, installed on the refrigerator 22 
provided in the kitchen 14, for detecting whether the 
door is Open or Close. 

[0040] The management unit 1 0, provided on the wall 
of the living room 15, comprises recording unit 23, de- 
termining unit 24, output unit 25, alarm transmitter unit 
26 and notifying unit 27 as shown in FIG. 2. 
[0041] The recording unit 23 is means for recording 
combined patterns of behavior of a resident in the resi- 
dence of FIG. 1 and operation of appliances installed in 
the residence. The determining unit 24 is means for 
comparing the actual behavior of the resident and the 
actual operation of appliances with patterns recorded in 
the recording unit 23 to determine whether a combina- 
tion of the actual behavior of the resident and the actual 
operation of appliances substantially accords with any 
patterns recorded in the recording unit 23 or not. 
[0042] Meanwhile, in this embodiment, the actual be- 
havior of a resident is detected by CCD cameras 1 a and 
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1b, an IR sensor 2, an in-bed/out-of-bed sensor 3, an 
air-quality sensor 4, a toilet sensor 5 and a PIT 11 and 
the information received by transmitter/receiver unit 12 
is also utilized for the behavior detection of the resident. 

5 Besides, the actual operation of appliances in this em- 
bodiment signifies the respective operations such as 
Open/Close of the windows 19 and 20 provided at the 
bed room 16 and the living room 15, power supply ON/ 
OFF of the TV set 21 disposed in the living room 1 5 and 

10 door Open/Close of the refrigerator 22 disposed in the 
kitchen 1 4, each of which is detected by the window 
Open/Close detective means 6, the window Open/Close 
detective means 7, the TV power supply ON/OFF de- 
tective means 8 or the refrigerator door Open/Close de- 

15 tective means 9. 

[0043] The output unit 25 is means for outputting the 
result determined by the determining unit 24. The alarm 
transmitter unit 26 is means for transmitting an alarm by 
a radio wave when it is determined by the determining 

20 unit 24 that a combination of actual behavior of the res- 
ident and actual operation of appliances does not sub- 
stantially accord with any pattern recorded in the record- 
ing unit 23. When it is determined by the determining 
means 24 that a combination of actual behavior of the 

25 resident and actual operation of appliances does not 
substantially accord with any pattern recorded in the re- 
cording unit 23, the notifying unit 27 is means for out- 
putting an alarm to a loudspeaker disposed in another 
residence than that of FIG. 1 and connected to the no- 

30 tifying unit 27 via a telephone line. Incidentally, the loud- 
speaker emits an alarm sound if an alarm from the no- 
tifying unit 27 is inputted thereto. Besides, the loud- 
speaker is not illustrated. 

[0044] The PIT 11 is a personal information terminal 
35 borne by the resident of FIG. 1 and capable of transmit- 
ting/receiving an information item by a radio wave and 
incorporates means for transmitting that ID number pe- 
culiar to the bearing resident which specifies the rele- 
vant resident by a faint radio wave when receiving a giv- 
40 en instruction from the transmitter/receiver unit 1 2 by a 
radio wave. Besides, the PIT 11 also incorporates 
means for receiving the alarm by a radio wave transmit- 
ted by the alarm transmitter unit 26 of the management 
unit 10 to emit a voice, vibration and flash based on the 
45 alarm and notify the alarm to the person bearing the PIT 
11. 

[0045] Besides, the PIT 11 has a gyro-sensor, accel- 
eration sensor and angle sensor and is also means for 
detecting the posture such as standing posture, seated 

so posture or lateral decubitus of its bearing person. Be- 
sides, the PIT 11 has a function for detecting the moving 
manner and the activity of its bearing person. Further- 
more, the PIT 1 1 incorporates means capable of detect- 
ing the physiological state such as heart-rate or body 

55 temperature of its bearing person. Incidentally, the 
transmitting/receiving of an information item by means 
of the PIT 11 is also performed in the communication 
form of a PHS system or in a specific small power com- 
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munication form using a frequency band of several hun- 
dred MHz. Besides, in FIG. 2, two PITs 11 are displayed, 
but sinceboth of themare identical and their functions 
are multiple, two PITs 11 are represented for conven- 
iences of description. 

[0046] The transmitter/receiver unit 1 2 is means dis- 
posed adjacent to the IR sensor 2 on the ceiling posi- 
tioned at the door separating the kitchen 1 4 and the liv- 
ing room 15 from each other, capable of transmitting/ 
receiving an information item by a radio wave and also 
means for specifying a moving person in case of infor- 
mation input from the IR sensor 2 to the effect that the 
move of a person was detected. 
[0047] The loudspeaker 13 is means for emitting an 
alarm sound when the determined result outputted by 
the output unit 25 of the management unit 10 is that a 
combination of actual behavior of the resident and op- 
eration of appliances does not substantially accord with 
any pattern recorded in the recording unit 23. 
[0048] Meanwhile, in Embodiment 1 , CCD cameras 
1a and 1b, an IR sensor 2, an in-bed/out-of-bed sensor 
3, an air-quality sensor 4, a toilet sensor 5, a PIT 1 1 and 
a transmitter/receiver unit 12 are used as one example 
of first detective means in a behavior determining appa- 
ratus according to the present invention as claimed in 
claim 1 . Besides, window Open/Close detective means 
6 and 7, TV power supply ON/OFF detective means 8 
and refrigerator door Open/Close detective means 9 are 
used as one example of second detective means in a 
behavior determining apparatus according to the 
present invention as claimed in claim 1 . Besides, record- 
ing unit 23, determining unit 24 and output unit 25 in the 
management unit 10 are respectively used as one ex- 
ample of recording means, determining means and out- 
put means in a behavior determining apparatus accord- 
ing to the present invention as claimed in claim 1 . 
[0049] Besides, in Embodiment 1 , transmitter/receiv- 
er unit 12 is used as one example of first transmitter/ 
receiver means in a behavior determining apparatus ac- 
cording to the present invention as claimed in claim 2 
and second transmitter/receiver means is assumed to 
be provided in the PIT 11. Besides, alarm transmitter 
unit 26 in management unit 10 is used as one example 
of alarm transmitter means in a behavior determining 
apparatus according to the present invention as claimed 
in claim 3 and alarm receiver means is assumed to be 
provided in the PIT 11. Besides, a loudspeaker 13 is 
used as one example of informing means in a behavior 
determining apparatus according to the present inven- 
tion as claimed in claim 4. Furthermore, notifying unit 27 
in the management unit 10 is used as one example of 
notifying means in a behavior determining apparatus ac- 
cording to the present invention as claimed in claim 5. 
[0050] Next, an operation of a behavior determining 
apparatus according to Embodiment 1 of the present in- 
vention will be described. 

[0051] First, a resident allows the recording unit 23 of 
the management unit 10 to record the behavior of the 
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subject resident, detected by CCD cameras 1a and 1b, 
an IR sensor 2, an in-bed/out-of-bed sensor 3, an air- 
quality sensor 4, a toilet sensor 5, a PIT 11 and trans- 
mitter/receiver unit 12. Besides, similarly when the be- 

5 havior is recorded in the recording unit 23 of the man- 
agement unit 10, the resident allows the recording unit 
23 to record the respective operations of Open/Close of 
windows 19 and 20, power supply ON/OFF of a TV set 
21 and door Open/Close of a refrigerator 22 detected 

10 by the window Open/Close detective means 6 and 7, 
the TV power supply ON/OFF detective means 8 and 
the refrigerator door Open/Close detective means 9. 
[0052] Here, for conveniences of the following de- 
scription, recording in the recording unit 23 the behavior 

is of the resident on the above subject and the respective 
operations of Open/Close of windows 1 9 and 20, power 
supply ON/OFF of a TV set 21 and door Open/Close of 
a refrigerator 22 is assumed to have continued for a pe- 
riod of one year in 1998. And, combinations of the be- 

20 havior of a resident and the respective operations of 
Open/Close of windows 19 and 20, power supply ON/ 
OFF of a TV set 21 and door Open/Close of a refriger- 
ator 22 recorded in the recording unit 23 are assumed 
to be averaged for each month and anew recorded as 

25 patterns regarding the behavior of the resident on the 
subject into the recording unit 23. 
[0053] Thus, in this embodiment, the recording unit 23 
ends in having recorded the averaged pattern regarding 
behavior of the resident on the subject for each month 

30 of 1998. Here, letting the pattern on July of 1998 and 
that on August of 1 998 recorded in the recording unit 23 
be first and second patterns, respectively, the portion of 
0:00 to 7:00 a.m. out of the first pattern and the portion 
of 8:00 a.m. to 3:00 p.m. out of the second pattern are 

35 shown in FIGS. 3 and 4, respectively. 

[0054] First, part of the first pattern will be described. 
As shown in FIG. 3, it was detected as the first pattern 
by the in-bed/ out-of-bed sensor 3 for detecting the load 
weight applied to the bed 1 7 and is recorded in the re- 

40 cording unit 23 that the resident was in the bed 1 7 from 
0:00 to 2:00 a.m. Thereafter, the load weight applied to 
the bed 17 became undetectable from 2:00 to 2:10 a.m. 
for the in-bed/out-of-bed sensor 3, it was detected by 
the toilet sensor 5 for measuring the rough position of a 

45 human body in the toilet 18 and is recorded in the re- 
cording unit 23 that the resident was in the toilet 18. 
Then, it was detected by the in-bed/out-of-bed sensor 3 
and is recorded in the recording unit 23 respectively that 
the resident was in the bed 17 from 2:10 to 6:00 a.m. 

50 and that the resident was out of the bed 1 7 from 6: 00 
to 7: 00 a.m. 

[0055] Besides, it was detected from 0:00 to 7:00 a. 
m., by the window Open/Close detective means 7, by 
the TV power supply ON/OFF detective means 8 and 
55 by the refrigerator door Open/Close detective means 9 
respectively and is recorded as part of the first pattern 
in the recording unit 23 that the window 20 was Close, 
that the power supply of the TV set 21 was OFF and that 
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the door of the refrigerator 22 was Close. Besides, it was 
detected by the window Open/Close detective means 6 
and is recorded as part of the first pattern in the record- 
ing unit 23 that the window 19 was Close from 0:00 to 
6:00 a.m. and Open from 6:00 to 7:00 a.m. Meanwhile, 
with respect to the operation of a first-pattern appliance, 
FIG. 3 demonstrates that the window 19 was Open from 
6:00 to 7:00 a.m. Besides, as mentioned above, the first 
pattern is a pattern averaged over July of 1998. 
[0056] Next, the second pattern will be described. 
From the result obtained from 8:00 to 9:30 a.m. as the 
second pattern that the figure of the resident is con- 
tained in the picture of the kitchen 14, photographed by 
the CCD camera 1a and the C0 2 concentration in the 
kitchen 1 4 measured by the air-quality sensor 4 exceed- 
ed a given threshold, it was detected as shown in FIG. 
4 and is recorded in the recording unit 23 that the resi- 
dent was in the kitchen 14. Incidentally, since the C0 2 
concentration in the kitchen 14 rises if a person is 
present in the kitchen 14, measuring the C0 2 concen- 
tration in the kitchen 14 by the air-quality sensor 4 
makes it possible to detect whether a person is present 
in the kitchen 14 or not. Besides, when a person has 
cooked in the kitchen 14, the humidity, the C0 2 concen- 
tration and the volatile organic component concentra- 
tion increases, so that the entire or partial measurement 
of the humidity, the C0 2 concentration and the volatile 
organic component concentration in the kitchen 14 by 
the air-quality sensor 4 also makes it possible to detect 
whether a person is present in the kitchen 14 or not. 
[0057] And, at 9:30 a.m., the IR sensor 2 detected the 
move of a person, the figure of the resident disappeared 
from the picture of the kitchen 1 4, photographed by the 
CCD camera 1a, the C0 2 concentration in the kitchen 
14 measured by the air-quality sensor 4 fell short of a 
given threshold, and further the figure of the resident 
was contained in the picture of the living room 15, pho- 
tographed by the CCD camera 1b. As a result, it was 
detected and is recorded in the recording unit 23 that 
the resident left the kitchen 14 and entered the living 
room 15. Thereafter, since the figure of the resident re- 
mained contained from 9:30 to 1 1 :00 a.m. in the picture 
of the living room 1 5, photographed by the CCD camera 
1 b, it was detected and is recorded in the recording unit 
23 that the resident was in the living room 15. 
[0058] And, at 11:00 a.m., the IR sensor 2 detected 
the move of a person again, the figure of the resident 
was contained in the picture of the kitchen 14, photo- 
graphed by the CCD camera 1 a and further the humidity, 
the C0 2 concentration and the volatile organic compo- 
nent concentration in the kitchen 14 measured by the 
air-quality sensor 4 exceeded given thresholds, with the 
result that it was detected and is recorded in the record- 
ing unit 23 that the resident was in the kitchen 14. And, 
from a third detection of IR reflection by the IR sensor 2 
and such others at 0:00 p.m., it is recorded in the re- 
cording unit 23 that the resident left the kitchen 14 and 
entered the living room 15. Thereafter, from 2:00 to 3: 
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00 p.m., since the load weight applied to the bed 1 7 was 
detected by the in-bed/out-of-bed sensor 3, it was de- 
tected and is recorded in the recording unit 23 that the 
resident was in the bed 17. 

5 [0059] Besides, the window Open/Close detective 
means 6 detected that the window 19 was Close from 
8:00 a.m. to 3:00 p.m. and the window Open/Close de- 
tective means 7 detected that the window 20 was Open 
from 9:30 to 10:00 a.m. and from 1:30 to 2:00 p.m. and 

10 Close in the other time zones, which fact is recorded as 
part of the second pattern in the recording unit 23. 
[0060] Besides, it was detected by the TV power sup- 
ply ON/OFF detective means 8 and is recorded also in 
the recording unit 23 that the power supply of a TV set 

15 21 was ON from 9:30 to 1 1 :00 a.m. and from 0:00 to 1 : 
30 p.m. and OFF in the other time zones. Furthermore, 
it was detected by the refrigerator door Open/Close de- 
tective means 9 and is recorded as part of the second 
pattern in the recording unit 23 that the door of the re- 

20 frigerator 22 discontinuously repeated the opening and 
closing from 11:00 to 11:10 a.m. and was Close in the 
other time zones. Incidentally, as mentioned above, the 
second pattern is an averaged pattern over August of 
1998. 

25 [0061] Meanwhile, when a resident moves from the 
kitchen 14 to the living room 15 or from the living room 
15 to the kitchen 14, the IR sensor 2 detects the move 
of a person and in this case, the IR sensor 2 outputs the 
information about the detection of a person's move to 

30 the transmitter/receiver unit 12. Then, the transmitter/ 
receiver unit 12 transmits such an instruction to the PIT 
11 as to dispatch the ID number for specifying the bearer 
of the PIT 11 by a radio wave having a high directivity 
in a limited space. Having received the instruction, the 

35 PIT 11 dispatches the ID numberforspecifying the bear- 
ing resident by a radio wave and the transmitter/receiver 
unit 1 2 specifies the person issuing the IR rays detected 
by the IR sensor 2 on the basis of the ID number from 
the PIT 11. In accordance with this specification, it is 

40 specified who is the resident having moved from the 
kitchen 14 to the living room 15 or from the living room 
15 to the kitchen 14. 

[0062] If a plurality of persons live in one residence, 
such an specification method can be used in case of 

45 specifying who is the person having moved from one of 
the adjoining rooms to the other and in case of specify- 
ing who is the person having moved from one to the oth- 
er between the adjoining room and the corridor. Inciden- 
tally, to specify who is the person having moved from 

so one to the other between the adjoining room and the 
corridor, means capable of specifying who is the person 
having moved from one to the other between a room 
and the corridor on the basis of the ID number from the 
PIT 1 1 as with the above transmitter/receiver unit 1 2 has 

55 to be installed, for example, on the ceiling of the adjoin- 
ing part between the room and the corridor. 
[0063] Next, the operation of a behavior determining 
apparatus according to Embodiment 1 of the present in- 
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vention after a first pattern and a second pattern are re- 
corded in the recording unit 23 will be described. For 
conveniences of description, the operation on July 22 
and August 3, 1 999 of a behavior determining apparatus 
according to Embodiment 1 of the present invention will 
be described. 

[0064] The behavior of a resident on July 22 and Au- 
gust 3, 1 999 is detected by means of CCD cameras 1a 
and 1 b, an IR sensor 2, an in-bed/out-of-bed sensor 3, 
an air-quality sensor 4, a toilet sensor 5 and a P IT 1 1 for 
either day and the respective detected data are inputted 
to the determining unit 24 shown in FIG. 2. Besides, the 
information of the bearer of the PIT 11 , specified by the 
transmitter/receiver unit 12, is also inputted to the de- 
termining unit 24. Besides, the Open/Close operation of 
the windows 19 and 20, the power supply ON/OFF op- 
eration of the TV set 21 and the door Open/Close oper- 
ation of the refrigerator 22 for either of July 22 or August 
3 are detected by the window Open/Close detective 
means 6 and 7, the TV power supply ON/OFF detective 
means 8 and refrigerator door Open/Close detective 
means 9, respectively and the respective detected data 
are inputted to the determining unit 24. 
[0065J Next, the operation of the determining unit 24 
will be described referring to the flowchart of FIG. 5, The 
determining unit 24 inputs not only the respective de- 
tected data mentioned above (step 1) but also the first 
and second patterns recorded in the recording unit 23 
(step 2) and determines whether a combination of be- 
havior of the resident and each of the operations of 
Open/Close of the windows 19 and 20, power supply 
ON/OFF of the TV set 21 and door Open/Close of the 
refrigerator 22 accords with the first pattern or the sec- 
ond pattern in a given period of time or within a given 
behavior range (step 3) and outputs the determined re- 
sult to the output unit 25 (step 4). 
[0066] A description will be made to cite a specific ex- 
ample. On July 22, for example, assuming that a resi- 
dent is in the bed 1 7 from 0:00 to 1 :55 a.m., leaves the 
bed 1 7 and goes to the toilet 1 8 at 1 :55 a.m. and returns 
to the bed 17 at 2:05 a.m., the behavior of the resident 
in this case is detected by means of the in-bed/out-of- 
bed sensor 3 and the toilet sensor 5 and inputted to the 
determining unit 24. Meanwhile, since the behavior of 
the resident inputted to the determining unit 24 shifts 
from the behavior from 0:00 to 2:1 0 a.m. of the first pat- 
tern described referring to FIG. 3 only by 5 min, the de- 
termining unit 24 determines that the actual behavior of 
the resident substantially accords with the behavior of 
a resident in the first pattern. Here, in a period of time 
ranging from 0:00 to 1 :55 a.m. of July 22, if the window 
Open/Close detective means 6, the window Open/Close 
detective means 7, the TV power supply ON/OFF de- 
tective means 8 and the refrigerator door Open/Close 
detective means 9 are assumed to respectively detect 
that the window 19 was Close, the window 20 was 
Close, the power supply of the TV set 21 was OFF and 
the door of the refrigerator 22 was Close, the determin- 
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ing unit 24 determines that a combination of the behav- 
ior of the resident and each of the operations of Open/ 
Close of the windows 1 9 and 20, power supply ON/OFF 
of the TV set 21 and door Open/Close of the refrigerator 

5 22 substantially accords with the first pattern and out- 
puts the determined result to the output unit 25. The out- 
put unit 25 outputs the determined result to the alarm 
transmitter unit 26 and the notifying unit 27. Since it was 
determined that a combination of the behavior of the res- 

10 jdent and each of the operations of the windows 1 9 and 
20, the TV set 21 and the door of the refrigerator 22 sub- 
stantially accords with the first pattern, the alarm trans- 
mitter unit 26 and the notifying unit 27 output no alarm. 
[0067] . Next, a description will be made to cite another 

15 specific example. For example, a case where a resident 
left the bed 1 7 and did not open the window 1 9 at 6:00 
a.m. on July 22 will be described. And, it is assumed 
that the window 19 was not opened later. The resident 
behavior in that case is detected by means of the in-bed/ 

20 out-of-bed sensor 3 and inputted to the determining unit 
24. Besides, the Open/Close operation of the window 
1 9 is detected by means of window Open/Close detec- 
tive means 6 and inputted to the determining unit 24. 
The resident behavior inputted to the determining unit 

25 24 accords with that subsequent to 6:00 a.m. in the first 
pattern, but the window 19 is not Open and accordingly 
the actual Open/Close operation of the window 1 9 does 
not accord with the Open/Close operation of the window 
19 in the first pattern. As a result, the determining unit 

30 24 determines that a combination of behavior of the res- 
ident and Open/Close operation of the window 1 9 does 
not substantially accord with the first pattern. 
[0068] And, the determining unit 24 outputs the deter- 
mined result that a combination of behavior of the resi- 

35 dent and Open/Close operation of the window 1 9 does 
not substantially accord with the first pattern to the out- 
put unit 25. Then, the output unit 25 outputs the deter- 
mined result to the alarm transmitter unit 26 and the no- 
tifying unit 27 and simultaneously to the loudspeaker 1 3. 

40 The alarm transmitter unit 26 transmits an alarm by a 
radio wave, while the PIT 11 receives the alarm by the 
radio wave and emits a voice, vibration and flash based 
on the alarm to notify an alarm to the bearer. Besides, 
the notifying unit 27 is disposed in another than the res- 

45 idence of FIG. 1 and outputs an alarm to a loudspeaker 
connected to the notifying unit 27 via a telephone line, 
thus forcing the emission of an alarm sound. Besides, 
based on the determined result from the output unit 25, 
the loudspeaker 13 emits an alarm sound. 

50 [0069] Since the PIT 1 1 and the loudspeaker 1 3 emit 
an alarm like this, the resident himself can perceive that 
the pattern pre-recorded in the recording unit 23 differs 
from the actual behavior and moreover other residents 
than the relevant person can also perceive that abnor- 

55 malities might occur on the behavior of the resident on 
the subject of judgement for the determining unit 24. Be- 
sides, based on the alarm from the notifying unit 27, res- 
idents in another than the residence of FIG. 1 also can 
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perceive that abnormalities might occur regarding be- 
havior of the resident on the subject of judgement for 
"the determining unit 24. Thus, if notifying unit 27 and a 
loudspeaker for emitting an alarm sound in accordance 
with the alarm outputted from the notifying unit 27 are 
disposed in a 2-generation residence, abnormalities oc- 
curring in an elderly person, for example, usually living 
alone for the most part of a day, can be rapidly known 
to his or her son or daughter. 
[0070] Also in former days, resident's leaving the bed 
17 and the Open/Close operation of a window 19 was 
individually detected, but it was not determined whether 
a combination of the behavior of a resident and the ac- 
companying operation of the window 1 9 did not substan- 
tially accord with a given pattern, so that the behavior 
of the subject resident after leaving the bed 1 7 was not 
specified more accurately. In contrast, with this embod- 
iment, since it is determined whether a combination of 
the behavior of a resident and the accompanying oper- 
ation of the window 1 9 substantially accords with a given 
pattern, the behaviorofthesubject resident after leaving 
the bed 17 is specified more accurately. Thus, in the 
case where a resident left the bed 17 at 6:00 a.m., fell 
down on account of abnormalities having occurred at 
this time in his or her body and consequently could not 
open the window 19, for example, the loudspeaker 13 
emits an alarm sound, so that other residents can rapidly 
take the corresponding measures on occurrence of ab- 
normalities in the body of the resident on the subject of 
judgement for the judging unit 24. Besides, in response 
to the alarm from the notifying unit 27, residents in other 
residences than that of FIG. 1 can also take similar 
measures rapidly. 

[0071] Meanwhile, as shown in FIG. 3, the first pattern 
recorded in the recording unit 23 describes only the fact 
of "having left the bed 17," detected by the in-bed/out- 
of-bed sensor 3, as the behavior of a person from 6:00 
to 7:00, but instead or additionally, data on the posture 
of a subject resident, detected the gyro-sensor, accel- 
eration sensor and angle sensor incorporated in the PIT 
11 , may be described. In that case, the determining unit 
24 will determine whether a combination of the behavior 
detected of a resident at least by means of the PIT 11 
and operation of appliances such as window 19 sub- 
stantially accords with a pattern including at least data 
on the posture of the resident or not. 
[0072] Thus, in determining case of the determining 
unit 24 when the data telling that a resident fell down 
after leaving the bed 17 is not described, for example, 
as the behavior of a person from 6:00 to 7:00 in part of 
the first pattern recorded in the recording unit 23, a res- 
ident is assumed to fall down after leaving the bed 17 
and the fact of falling down is detected by the PIT 11, so 
that the determining unit 24 determines that the behav- 
ior of the resident does not accord with the pattern, thus 
resulting in the emission of an alarm. 
[0073] Furthermore, a description will be made to cite 
yet another specific example. On August 3, when a res- 
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ident entered the kitchen 14 at 11:00 p.m. and opened 
the door of a refrigerator 22 in attempt to begin the prep- 
aration of a lunch, it is assumed that abnormalities oc- 
curred in his body and he fell down. His behavior in that 

5 case is detected by means of the CCD camera 1 a and 
the air-quality sensor 4 and inputted to the determining 
unit 24. Besides, the door Open/Close operation of the 
refrigerator 22 is detected by the refrigerator door Open/ 
Close detective means 9 and inputted to the determining 

10 unit 24. The behavior of the resident inputted to the de- 
termining unit 24 substantially accords with that subse- 
quent to 1 1 :00 p.m. in the second pattern described re- 
ferring to FIG. 4, but the door of the refrigerator 22 re- 
mains opened and accordingly the actual door Open/ 

15 Close operation of the refrigerator 22 does not accord 
with the door Open/Close operation in the second pat- 
tern. As a result, the determining unit 24 determines that 
a combination of the behavior of the resident and the 
door Open/Close operation of the refrigerator 22 does 

20 not substantially accord with the second pattern. 

[0074] Then, the determining unit 24 outputs the de- 
termined result that a combination of the behavior of the 
resident and the door Open/Close operation of the re- 
frigerator 22 does not substantially accord with the sec- 

25 ond pattern to the output unit 25. The output unit 25 out- 
puts the determined result to the alarm transmitter unit 
26 and the notifying unit 27 and simultaneously to the 
loudspeaker 1 3. The alarm transmitter unit 26 transmits 
an alarm by a radio wave, while the PIT 1 1 receives the 

30 alarm by the radio wave and emits a voice, vibration and 
flash based on the alarm to notify an alarm to the bearer. 
Besides, the notifying unit 27 outputs an alarm to a loud- 
speaker connected to the notifying unit 27 via a tele- 
phone line, thus forcing the emission of an alarm sound. 

35 The loudspeaker is disposed in another than the resi- 
dence of FIG. 1 . Besides, based on the determined re- 
sult from the output unit 25, the loudspeaker 13 emits 
an alarm sound. 

[0075] Since the PIT 1 1 and the loudspeaker 13 emit 
40 an alarm like this, other residents can perceive that ab- 
normalities might occur on the behavior of the resident 
in the subject of judgement for the determining unit 24. 
Besides, based on the alarm from the notifying unit 27, 
residents in another than the residence of FIG. 1 also 
45 can perceive that abnormalities might occur regarding 
behavior of the resident on the subject of judgement for 
the determining unit 24. 

[0076] Meanwhile, as shown in FIG. 4, the second 
pattern recorded in the recording unit 23 describes only 

50 the fact of "being present in the kitchen 1 4, "detected by 
the CCD camera 1a or the air-quality sensor 4, as the 
behavior of a person from 1 1 :00 to 12:00, but instead or 
additionally, data on the posture of a subject resident, 
detected by the gyro-sensor, acceleration sensor and 

55 angle sensor incorporated in the PIT 11, may be de- 
scribed. In that case, the determining unit 24 will deter- 
mine whether a combination of the behavior of a resi- 
dent detected at least by means of the PIT 11 and the 
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operation of an appliance such as door operation of a 
refrigerator 22 substantially accords with a pattern in- 
cluding at least data on the posture of the resident or 
not. Thus, in determining case of the determining unit 
24 when the data telling that a resident fell down is not 
described, for example, as the behavior of the subject 
from 1 1 :00 to 1 2:00 in part of the second pattern record- 
ed in the recording unit 23, a resident is assumed to fall 
down in the kitchen 14 and the fact of falling down is 
detected by the PIT 11 , so that the determining unit 24 
determines that the behavior of the resident does not 
accord with the pattern, thus resulting in the issue of an 
alarm. 

[0077] As described above, a behavior determining 
apparatus according to Embodiment 1 of the present in- 
vention can determine whether the combined pattern of 
behavior of a given subject person and a given appli- 
ance, pre-recorded in the recording unit 23, substantial- 
ly accords with a combination of the behavior of the ac- 
tual subject person and the operation of the actual ap- 
pliance and outputs the determined result, so that ab- 
normalities in the behavior of the subject person is in- 
ferred more accurately and more rapidly. Besides, the 
subject person himself can also perceive that he has be- 
haved differently from the pattern. 
[0078] Meanwhile, in Embodiment 1 , a case where in- 
dividual constituent means of a behavior determining 
apparatus are disposed at the respective positions of a 
residence was described, but individual constituent 
means of a behavior determining apparatus are not re- 
stricted to be disposed onty at the respective positions 
of a residence but may be disposed at a hospital, a pro- 
tective institution or the like, for example. In that case, 
when the output unit 25 or the notifying unit 27 outputs 
the determined result to the management station such 
as nursing station of a hospital directly or via other ap- 
pliances, the management staff such as nurses can 
grasp the behavior of subject persons more accurately. 
[0079] Besides, many subject persons are present in 
a hospital, a protective institution or the like, while if each 
subject person is allowed to bear transmitter means for 
transmitting an ID number peculiar to the bearing resi- 
dent for specifying him by a radio wave, similar to the 
second transmitter/receiver means provided in the 
above PIT 11 , or to bear the above PIT 11 , it is specified 
who is the person detected by detective means such as 
an IR sensor for detecting the personal behavior. Inci- 
dentally, in the case where the subject lives alone and 
individual constituent means of a behavior determining 
apparatus are installed at his residence, for example, 
there is only a single subject person in the residence 
and accordingly it is unnecessary for the PIT 11 to have 
means for specifying its bearer provided. Besides, in this 
case, the determined result determined by the determin- 
ing unit 24 is outputted to the managing center for nurs- 
ing subject persons of a public welfare institution or the 
like outside the residence via the output unit 25 or via 
the output unit 25 and the notifying unit 27 and the be- 



havior of subject persons are managed by a public wel- 
fare institution or the like. 

[0080] Besides, in Embodiment 1, it was not men- 
tioned who is the subject for the judgement of a behavior 

5 determining apparatus, but in case of a senile dementia 
as subject, the behavior determining apparatus issues 
an alarm if the using manner of water in the toilet unit 
differs from the pattern recorded in the recording unit 
23, for example, even when the period of time while the 

10 subject is in the toilet 1 8 is identical to the period of time 
of the pattern recorded in the recording unit 23. Thus, 
other residents can perceive such an abnormal behavior 
that an elderly person has played in the toilet 18 or has 
washed something in a stool. Besides, when an elderly 

is person has forgotten to extinguish the fire of a gas range 
after the cooking in the kitchen 14, for example, other 
residents can perceive that abnormalities occurred in 
the elderly person because the behavior determining 
apparatus issues an alarm if a combination of his be- 

20 havior detected by means of the CCD camera 1 a or the 
. like and the operation of a gas range does not substan- 
tially accord with the pattern recorded in the recording 
unit 23. 

[0081 ] Besides, when an elderly person got up at mid- 
25 night, walked round in a house and wandered about, for 
example, other residents can also perceive that abnor- 
malities occurred in the elderly person because the be- 
havior determining apparatus issues an alarm if a com- 
bination of his or her behavior and operation of appli- 
30 ances in the house does not substantially accord with 
the pattern recorded in the recording unit 23. Thus, even 
if an elderly person actually went to the toilet 18 or the 
kitchen 14 at the time when he was scheduled to leave 
the bed 1 7 and go to the toilet 1 8 or the kitchen 1 4 ac- 
35 cording to the pattern recorded in the recording unit 23, 
other residents can also perceive that abnormalities oc- 
curred in the elderly person if neither the refrigerator 22 
nor the toilet unit was used though the refrigerator 22 or 
the toilet unit is scheduled to be used in the pattern. 
40 [0082] Besides, in case of a hypertension middle- 
aged or elderly person as subject, for example, when 
the person fell down in the kitchen 1 4, the position of the 
middle-aged or elderly person is detected by means of 
the CCD camera 1a, the activity or posture is detected 
^5 by means of a gyro-sensor, an acceleration sensor and 
an angle sensor incorporated in the PIT 11 and the op- 
eration of equipped appliances in the kitchen 14 is also 
detected. Other residents can perceive that abnormali- 
ties occurred in the middle-aged or elderly person be- 
so cause the behavior determining apparatus issues an 
alarm if a combination of his or her behavior detected 
and the operation of equipped appliances does not sub- 
stantially accord with the pattern recorded in the record- 
ing unit 23. 

55 [0083] Besides, in Embodiment 1 , CCD cameras 1a 
and 1b, an I R sensor 2, an in-bed/out-of-bed sensor 3, 
an air-quality sensor 4, a toilet sensor 5, a PIT 11 and 
transmitter/receiver unit 12 were used as one example 
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of first detective means in a behavior determining appa- 
ratus according to the present invention as claimed in 
claim 1 , but the first detective means is not limited to the 
CCD camera 1 or IR sensor 2. If only capable of detect- 
ing the behavior of a subject, any is available for first 
detective means. Besides, as the behavior of a subject, 
the posture, the moving manner and the activity are also 
included. All of them are detected by means of a PIT 11 . 
[0084] Besides, in Embodiment 1 , the PIT 1 1 was as- 
sumed to transmit an ID number for specifying its bearer 
by a radio wave when receiving a given instruction from 
the transmitter/receiver unit 12, but transmitter means 
such as PIT 11 may be assumed to regularly or irregu- 
larly transmit an ID number for specifying individual res- 
idents by a radio wave regardless of whether it has re- 
ceived a given instruction from the transmitter/receiver 
unit 12. 

[0085] Besides, in Embodiment 1 , the transmitter/re- 
ceiver unit 1 2 was assumed to specify the bearer of the 
PIT 11 , but all or part of the CCD cameras 1a and 1b, 
the IR sensor 2, the in-bed/out-of-bed sensor 3, the air- 
quality sensor 4 and the toilet sensor 5 are assumed to 
have a function for specifying the bearer of the PIT 11 
and specify the bearer of the PIT 11 by using the ID 
number by the radio wave from the PIT 11 . 
[0086] Besides, in Embodiment 1, window Open/ 
Close detective means 6 and 7, TV power supply ON/ 
OFF detective means 8 and refrigerator door Open/ 
Close detective means 9 were used as one example of 
second detective means in a behavior determining ap- 
paratus according to the present invention as claimed 
in claim 1 , but the second detective means is not limited 
to the window Open/Close detective means 6 or the TV 
power supply ON/OFF detective means 8 mentioned 
above. The second detective means has only to be any 
of those which detect the operation of a given appliance. 
[0087] Besides, in Embodiment 1, the recording unit 
23 was assumed to have recorded first and second pat- 
terns, but the recording unit 23 has only to have record- 
ed one or more of the combined patterns of behavior of 
a subject person and operation of appliances. Thus, the 
recording unit 23 is not restricted in having recorded the 
averaged pattern for each month during one year of 
1 998 mentioned above, but may have recorded the de- 
tected data of only one day as a pattern, or the averaged 
data over one month or the data averaged for each 
weekday of the one-month detected data as patterns. 
In brief, the recording unit 23 has only to have recorded 
one or more of combinations of behavior of a subject 
person and operation of appliances. Besides, the deter- 
mining unit 24 has only to compare one or more patterns 
recorded in the recording unit 23 with the actual behav- 
ior of a subject person and the actual operation of ap- 
pliances and determine whether a combination of the 
actual behavior of a subject person and the actual op- 
eration of appliances substantially accords with any of 
the patterns recorded in the recording unit 23. Inciden- 
tally, the above expression of "substantially accord" sig- 



nifies either a case where a combination of behavior of 
a subject person and operation of appliances accords 
with a pattern within a given time range, for example, 
within 1 0 min or a case where, for example, two different 

5 behavioral ways of a subject person comprising stand- 
ing in the kitchen 14 and squatting in the kitchen 14 are 
identical in that the subject person is present in the kitch- 
en 14 and accordingly a combination of behavior of a 
subject person and operation of appliances accords with 

10 any pattern within a given behavior range of the subject 
person and/or within a given operation range of appli- 
ances. 

[0088] Besides, in Embodiment 1 , the loudspeaker 1 3 
was assumed to issue an alarm sound in the case where 

15 a judgement that a combination of behavior of a subject 
person and operation of door Open/Close of the refrig- 
erator 22 does not substantially accord with either the 
first pattern or the second pattern was made by the de- 
termining unit 24, but an alarm lamp for indicating an 

20 alarm by an optical signal may be used in place of the 
loudspeaker 13. In brief, an alarm has only to be output- 
ted in the case where a judgement that a combination 
of behavior of a subject person and operation of appli- 
ances does not substantially accord with either the first 

25 pattern or the second pattern recorded in the recording 
unit 23 was made by the determining unit 24. 
[0089] Besides, in Embodiment 1 , the notifying unit 27 
was assumed to output an alarm to the loudspeaker 
connected via a telephone line to the notifying unit 27 

30 and cause the loudspeaker to issue an alarm sound, but 
an alarm lamp for indicating an alarm by a light signal 
may be used in place of the loudspeaker connected via 
a telephone line to the notifying unit 27. Besides, rather 
than connected via a telephone line, the notifying unit 

35 27 may be assumed to be connected via an electric light 
line or an exclusive line to a loudspeaker or an alarm 
lamp disposed in another than the residence of FIG. 1 . 
Anyhow, in the case where made by the determining unit 
24 is a determining that a combination of behavior of a 

40 subject person and operation of appliances does not 
substantially accord with any of the patterns recorded 
in the recording unit 23, the notifying unit 27 has only to 
output an alarm to a connected loudspeaker or alarm 
light. 

45 [0090] Besides, in Embodiment 1, the determining 
unit 24 was assumed to determine whether a combina- 
tion of behavior of a subject person and operation of ap- 
pliances accords with any of the patterns recorded in 
the recording unit 23, but the determining unit 24 may 

so be assumed to determine whether a combination of be- 
havior of a subject person, operation of appliances and 
physiological and/or psychological state of the subject 
person substantially accord with any of the patterns re- 
corded in the recording unit 23. In that case, the patterns 

55 recorded in the recording unit 23 must be combined pat- 
terns of behavior of a subject person, operation of ap- 
pliances and physiological and/or psychological state of 
the subject person. Furthermore, third detective means 
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must be provided for detecting physiological and/or psy- 
chological state of the subject person. 
[0091 ] Usable as means for detecting the physiologi- 
cal state of one subject person for the third detective 
means are, for example, a clinical thermometer for 
measuring the body temperature of a subject person, a 
sweating meter fomneasuring the sweating quantity of a 
subject person or a pulsimeter for measuring the heart 
rate of a subject person. Since the PIT 11 incorporates 
a function capable of detecting the physiological state 
such as heart-rate or body temperature of a bearer as 
mentioned above, it is only necessary to allow the PIT 
11 to transmit physiological information items such as 
heart-rate or body temperature of a subject person reg- 
ularly or irregularly by a radio wave and to allow the 
transmitter/receiver unit 12 to receive the radio wave. 
And, the physiological information items are inputted to 
the determining unit 24. Incidentally, they may be input- 
ted to the determining unit 24 directly by a subject him- 
self or his or her caretaker. Besides, usable as means 
for detecting the psychological state of the other subject 
person for the third detective means are, for example, 
all or part of the clinical thermometer, the sweating meter 
and the pulsimeter mentioned above and an instrument 
for evaluating a change in psychological state from a 
change in body temperature, sweating quantity or heart 
rate. 

[0092] Like this, individual detective means are made 
to detect the behavior of a subject person , the operation 
of appliances and the physiological state of a subject 
person and/or the psychological state of a subject per- 
son and combinations of behavior of a subject person, 
operation of appliances and physiological state of a sub- 
ject person and/or psychological state of a subject per- 
son are pre-recorded as patterns in the recording unit 
23. And, the determining unit 24 is may be allowed to 
determine whether a combination of behavior of a sub- 
ject person, operation of appliances and physiological 
state of a subject person and/or psychological state of 
a subject person substantially accords with any pattern 
or not. As a result, a case of comparing a combination 
of behavior of a subj ect person , operation of appliances 
and physiological state of a subject person and/or psy- 
chological state of a subject person with any pattern is 
more accurately determined on whether the behavior of 
a subject person substantially accords with any pattern 
than a case of comparing a combination of behavior of 
a subject person and operation of appliances with any 
pattern. 

[0093] Besides, in the case where made by the deter- 
mining unit 24 is a judgement that a combination of be- 
havior of a subject person, operation of appliances and 
physiological state of a subject person and/or psycho- 
logical state of a subject person does not substantially 
accord with any of the patterns recorded in the recording 
unit 23, the output unit 25 outputs an alarm to informing 
means such as loudspeaker 13 or alarm lamp and 
makes the alarm notified by means of a voice or an op- 



24 

tical signal. Besides, similarly in the case where the 
judgement made by the determining unit 24 is NO, the 
alarm transmitter unit 26 transmits an alarm by a radio 
wave, while the PIT 1 1 is made to receive the alarm and 

5 to generate a voice, vibration and light based on the 
alarm, so that the bearer is notified of the alarm. Fur- 
thermore, similarly in the case where the judgement 
made by the determining unit 24 is NO, the notifying unit 
27 outputs an alarm to a loudspeaker and an alarm lamp 

10 connected thereto via a telephone line, an electric light 
line or an exclusive line, thereby notifying the alarm. 
[0094] Thus, in the case where an information item 
about body temperature or heart rate of a resident in the 
bed 1 7 is pre-recorded as a pattern in the recording unit 

15 23 together with the information that a resident is in the 
bed 17 and the information item about operation of ap- 
pliances, for example, the determining unit 24 deter- 
mines that the physiological state does not accord with 
the pattern on the basis of the body temperature and 

20 heart-rate rate of a subject person detected by the third 
detective means such as PIT 11 and issues an alarm 
correspondingly if the resident is in the bed 17 and the 
operation of appliances is substantially the same as the 
recorded pattern but the body temperature and the heart 

25 rate of the resident in the bed 1 7 are higher than those 
of the pattern in determining by the determining unit 24. 
As a result, it is more accurately inferable that abnor- 
malities such as catching cold has occurred in the body 
of a resident. 

30 [0095] Incidentally, as with the first detective means, 
the third detective means may be provided with a func- 
tion of specifying a subject person by use of the infor- 
mation item through a radio wave and a function capable 
of detecting the physiological state and/or the psycho- 

35 logical state of the person. Besides, as mentioned 
above, the PIT 11 can be used as one example of third 
detective means. 

[0096] Besides, in the health care for a subject per- 
son, the determined result of the above behavior deter- 

40 mining apparatus may be used by the subject himself 
or by the caretaker of the subject person. 
[0097] Besides, individual constituents of a behavior 
determining apparatus according to Embodiment 1 en- 
tirely or partially belong to hardware or software having 

45 the same function as the relevant hardware. 

[0098] Besides, medium bearing a program and/or 
data for allowing the functions of all or part of the con- 
stituents of the above behavior determining apparatus 
to be entirely or partially executed by a computer which 

so can be processed by the computer also belongs to the 
present invention. 

[0099] In media according to the present invention, re- 
cording medium such as ROM, transmittal medium such 
as internet and transmittal medium such as light, radio 
55 wave and sound wave are included. Examples of bear- 
ing media include recording media with a program and/ 
or data recorded and transmission media for transmit- 
ting a program and/or data. 
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[0100] Thus, recording media with a program and/or 
data recorded for allowing the functions of all or part of 
the constituents of the above behavior determining ap- 
paratus to be entirely or partially executed by a compu- 
ter which can be read by the computer so that the above 
program read and/or the above data read execute the 
above function in cooperation with the above computer 
also belong to the present invention. 
[01 01 ] Meanwhile, processible by a computer means, 
for example, readable by a computer in case of a re- 
cording medium such as ROM or processible by a com- 
puter as a result of transmitting a program and/or data 
to be transmitted in case of transmission media. 
[0102] Furthermore, an information aggregate com- 
prising programs and/or data for allowing the functions 
of all or part of the constituents of the above behavior 
determining apparatus to be entirely or partially execut- 
ed by a computer also belongs to the present invention. 
[0103] The information aggregate includes software 
such as program and/or data. 
[0104] Incidentally, data in the media and information 
aggregate mentioned above include a data structure, a 
data format and a data type. 

(Embodiment 2) 

[01 05] Next, a configuration of a care system accord- 
ing to embodiment 2 will be described using FIGS. 1 and 
6. 

[0106] FIG. 1 is a drawing for explaining the location 
of each component unit when the several component 
units configuring the behavior determining apparatus of 
the above described embodiment 1 are installed in var- 
ious locations in a residence, etc. As explained later, 
some of the component units configuring the care sys- 
tem of this embodiment 2 are the same as some of the 
component units configuring the behavior determining 
apparatus of embodiment 1, and therefore FIG. 1 will 
also be used when describing the care system of em- 
bodiment 2. FIG. 6 is a block diagram of the care system 
of embodiment 2. 

[0107] As shown in FIG. 6, the care system of embod- 
iment 2 is configured by CCD cameras 1a and 1b, an 
infrared ray sensor 2, an in-bed state sensor 3, an air 
quality sensor 4, a toilet sensor 5, window open/close 
detectors 6 and 7, a TV power on/off detector 8, a re- 
frigerator door open/close detector 9, a management 
unit 28, a PIT 11 , a transmitter/receiver 12, and a loud- 
speaker 13. The CCD cameras 1 a and 1b, infrared ray 
sensor 2, in-bed state sensor 3, air quality sensor 4, toi- 
let sensor 5, window open/close detectors 6 and 7, TV 
power on/off detector 8, refrigerator door open/close de- 
tector 9, PIT 11 , transmitter/receiver 12, and loudspeak- 
er 1 3 are the same as the relevant component units con- 
figuring the behavior determining apparatus of embod- 
iment 1 described using FIGS. 1 and 2 
[0108] The management unit 28 is installed within a 
wall of the living room 15 in FIG. 1 , in the same way as 



the management unit 1 0 of the behavior determining ap- 
paratus of embodiment 1, and, as shown in FIG. 6, is 
configured by an specifying unit 29, an information pro- 
viding unit 30, a control unit 31 , and a notifying unit 32. 

5 [0109] The specifying unit 29 is means for accurately 
specifying the behavior of the resident from detected 
resident behavior and detected device actions. The be- 
havior of the resident is detected by means of the CCD 
cameras 1a and 1b, infrared ray sensor 2, in-bed state 

w sensor 3, air quality sensor 4, toilet sensor 5, and PIT 
11 , and information, etc., received by the transmitter/re- 
ceiver 12 is also used for resident behavior detection. 
Device actions, on the other hand, mean opening and 
closing actions for the windows 19 and 20 provided in 

is the bedroom 1 6 and living room 1 5 in FIG. 1 , power on/ 
off actions for the TV 21 located in the living room 15, 
and opening and closing actions for the door of the re- 
frigerator 22 located in the kitchen 1 4, and these actions 
are detected, respectively, by the window open/close 

20 detector 6, window open/close detector 7, TV power on/ 
off detector 8, and refrigerator door open/close detector 
9. 

[0110] The information providing unit 30, in which 
many items of information relating to the care of the res- 

25 ident are set, is means for selecting one or a plurality of 
information items from the many information items set, 
on the basis of the behavior of the resident accurately 
specified by the specifying unit 29, and providing that 
selected information. This selected information is output 

30 from the loudspeaker 1 3. An actual example of care-re- 
lated information will be described when the operation 
of the care system of embodiment 2 is explained later. 
[0111] The control unit 31 is means for controlling the 
actions of devices located in the resident's residence 

35 based on the behavior of the resident accurately spec- 
ified by the specifying unit 29, and is connected by ca- 
bles to the devices subject to control. In embodiment 2, 
the window 20 provided in the living room 15 is used as 
an example of a device subject to control. 

40 [0112] The notifying unit 32 is means for giving notifi- 
cation of the behavior of the resident accurately speci- 
fied by the specifying unit 29 is means for outputting the 
accurately specified residents behavior to a loudspeak- 
er connected to the notifying unit 32 via a telephone line. 

45 The loudspeaker is located in a residence separate from 
the residence in which the resident lives. This loud- 
speaker outputs the accurately specified resident's be- 
havior in speech form from the notifying unit 32. This 
loudspeaker is not shown in the figure. 

so [01 1 3] In embodiment 2, the CCD cameras 1 a and 1 b, 
infrared ray sensor 2, in-bed state sensor 3, air quality 
sensor 4, toilet sensor 5, PIT 11 , and transmitter/receiv- 
er 12 are used as an example of the first detecting 
means of the care systems Also, the window open/close 

55 detectors 6 and 7, TV power on/off detector 8, and re- 
frigerator door open/close detector 9 are used as an ex- 
ample of the second detecting means of the care sys- 
tems. Further, the specifying unit 29 within the manage- 
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ment unit 28 are used as an example of the specifying 
unit of the care systems. 

[0114] In embodiment 2, the information providing 
unit 30 within the management unit 28 is used as an 
example of the information providing unit of the care sys- 
tem, the control unit 31 within the management unit 28 
is used as an example of the control unit of the care 
system according to claim 13, and the notifying unit 32 
within the management unit 28 is used as an example 
of the notifying unit of the care system. 
[01 1 5] Next, the operation of the care system accord- 
ing to embodiment 2 will be described. 
[01 1 6] As described in embodiment 1 , the CCD cam- 
eras 1 a and 1 b, infrared ray sensor 2, in-bed state sen- 
sor 3, air quality sensor 4, toilet sensor 5, and PIT 11 
detect the behavior of the sub] ect resident, and output 
the various detection data to the specifying unit 29 within 
the management unit 28. Also, as described in embod- 
iment 1 , the transmitter/receiver 12 outputs information 
on the person carrying the specified P IT 1 1 to the spec- 
ifying unit 29. The window open/close detectors 6 and 
7, TV power on/off detector 8, and refrigerator door 
open/close detector 9 detect, respectively, window 19 
and 20 opening and closing actions, TV 21 power on/off 
actions, and refrigerator 22 door opening and closing 
actions, and output the respective detection data to the 
specifying unit 29. 

[01 17] The specifying unit 29 specifies the exact be- 
havior of the resident on the basis of the input resident 
behavior detection data and device action detection da- 
ta. For example, if the resident is detected to be in the 
living room 15 for a long time by the CCD camera 1b, 
and during the time in which that resident is detected to 
be in the living room 15, the power of the TV 21 is de- 
tected to be on by the TV power on/off detector 8, the 
specifying unit 29 specifies the fact that the resident has 
been watching TV for a long time in the living room 15. 
[0118] The information providing unit 30 selects and 
provides information on the basis of the exact behavior 
of the resident specified by the specifying unit 29, and 
outputs that information to the loudspeaker 13. For ex- 
ample, if the specifying unit 29 specifies the fact that the 
resident has been watching TV 21 for a long time in the 
living room 15, as described above, since this implies a 
lack of exercise, information advising the resident to go 
out and take some exercise is provided, together with 
an exercise menu listing suitable kinds of exercise. In- 
formation to be provided is set in the information provid- 
ing unit 30, and some of that set information comprises 
information recommending bodily exercise, and exer- 
cise menus. For example, there may be a number of 
applicable exercise menus based on the length of time 
for which the resident has not moved, with a suitable 
menu being selected and provided. 
[0119] The control unit 31 controls window20 opening 
and closing actions on the basis of the exact behavior 
of the resident specified by the specifying unit 29. For 
example, if the specifying unit 29 specifies the fact that 



the resident has been watching TV 21 for a long time in 
the living room 15, as described above, the control unit 
31 will determine the ventilation of the living room 15 to 
be inadequate, and open the window for, say, ten min- 
5 utes. 

[01 20] The notifying unit 32 outputs the exact behav- 
ior of the resident, specified by the specifying unit 29, to 
a loudspeaker installed in a residence separate from 
that of the resident. This loudspeaker thus outputs the 
10 accurately specified behavior of the resident in speech 
form. Therefore, a resident of a different residence can 
ascertain the accurately specified behavior of the sub- 
ject resident. 

[0121] In the above described embodiment 2, the op- 
's eration of the care system has been described taking 
the example of the case where the resident is specified 
as having been watching TV 21 for a long time in the 
living room 15, based on the input resident behavior de- 
tection data and device action detection data. Thus, the 
20 specifying unit 29 of the present invention is means for 
specifying the exact behavior of a resident on the basis 
of the input resident behavior detection data and device 
action detection data, and enables specification of the 
fact that, for example, the resident's activity pattern is 
25 abnormal, or that the resident is going to the toilet fre- 
quently, is taking a nap on the sofa, is wandering about 
at night, or has fallen in the toilet or bathroom. 
[0122] If the specifying unit 29 finds that the resident's 
activity pattern is abnormal, for example, the information 
30 providing unit 30 will select and provide information urg- 
ing regular sleeping and waking habits from among the 
many set pieces of information. And if the specifying unit 
29 finds that the resident is visiting the toilet frequently, 
for example, the information providing unit 30 will select 
35 and provide information suggesting the possibility of di- 
abetes, or information recommending consulting a doc- 
tor, from among the many set pieces of information. 
[0123] If the specifying unit 29 finds that the resident 
is taking a nap on the sofa, for example, the information 
40 providing unit 30 will select and provide the information 
"You will catch cold" and the loudspeaker 1 3 output that 
information in speech form, while the control unit 31 con- 
trols the lighting units and air conditioner to darken the 
room and adjust the room temperature to a level that will 
45 prevent the resident from catching cold. Also, the noti- 
fying unit 32 will output information indicating that the 
resident is napping on the sofa, to a loudspeaker in- 
stalled in another residence. As this loudspeaker thus 
outputs the accurately specified behavior of the resident 
so in speech form, the resident of the other residence is 
able to ascertain the fact that the subject resident is nap- 
ping on the sofa, and take the subject resident a blanket. 
[01 24] . If the specifying unit 29 finds that the resident 
is wandering at night, or has fallen in the toilet or bath- 
55 room, for example, the notifying unit 32 will output infor- 
mation to that effect to a loudspeaker installed in another 
residence. As this loudspeaker thus outputs the accu- 
rately specified behavior of the resident in speech form, 
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the resident of the other residence is able to ascertain 
the fact that the subject resident is wandering at night 
or has fallen in the toilet or bathroom, and take appro- 
priate action. 

[0125] Thus far, it has been assumed that the speci- 
fying unit 29 specifies the exact behavior of the resident 
on the basis of input resident behavior detection data 
and device action detection data, but it is also possible 
for detection data whereby the physiological state and/ 
or psychological state of the resident are specified also 
to be input, and the behavior of the resident to be accu- 
rately specified. In this case, a third detecting means is 
necessary to enable the physiological state and/or psy- 
chological state of the resident to be specified, and the 
third detecting means described in embodiment 1 can 
be used as this third detecting means. 
[0126] If the specifying unit 29 specifies an increase 
in the resident's heart rate or blood pressure, for exam- 
ple, the information providing unit 30 provides informa- 
tion to that effect, and also provides information recom- 
mending consulting a doctor. Using a third detecting 
means in this way, capable of detecting the physiologi- 
cal state and/or psychological state of the resident, al- 
lows health management for middle-aged and elderly 
persons with high blood pressure. 
[0127] If the specifying unit 29 finds that the resident 
tends to stay indoors and, according to the results of 
psychological tests, is found to suffer from mental 
stress, the control unit 31 will control the operation of a 
stereo player to output soothing music, and control the 
air conditioner to increase the indoor negative ion count. 
In addition, the control unit 31 will control the operation 
of the lighting units and an aroma generator to provide 
soothing lighting and a soothing aroma indoors. 
[0128] In the above described embodiment 2, the 
CCD cameras 1 a and 1 b, infrared ray sensor 2 , in-bed 
state sensor 3, air quality sensor 4, toilet sensor 5, PIT 
1 1 , and transmitter/receiver 1 2 are used as an example 
of the first detecting means of the care systems; how- 
ever, the first detecting means is not limited to the above 
described CCD cameras 1 and infrared ray sensor 2. 
The first detecting means can be any means of detecting 
the behavior of the subject resident. 
[01 29] I n the above described embodiment 2, the win- 
dow open/close detectors 6 and 7, TV power on/off de- 
tector 8, and refrigerator door open/close detector 9 are 
used as an example of the second detecting means of 
thecare systems; however, the second detecting means 
is not limited to the above described window open/close 
detector 6 and TV power on/off detector 8. The second 
detecting means can be any means of detecting the ac- 
tions of the relevant devices. 
[01 30] I n the above described embodiment 2, the con- 
trol unit 31 is used as an example of the control means 
of the care system, according to claim 13, and this con- 
trol unit 31 is taken as controlling the operation of the 
window 20, etc.; however, the control unit 31 is not lim- 
ited to control of the operation of the window 20, etc., 
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but is a unit that controls the operation of devices in- 
stalled in the resident* s residence, on the basis of the 
behavior of the resident accurately specified by the 
specifying unit 29. 

5 [0131] In the above described embodiment 2, the no- 
tifying unit 32 output the behavior of the resident accu- 
rately specified by the specifying unit 29 to a loudspeak- 
er connected to the notifying unit 32 by a telephone line; 
the loudspeaker is installed in a different residence from 

10 that of the subject resident, however, the notifying unit 
32 and the loudspeaker can also be connected by an 
electric light cable or dedicated line, rather than a tele- 
phone line. Also, instead of a loudspeaker, a display unit 
can be used that displays the accurately specified be- 

15 havior of the resident by means of optical signals. 
[01 32] Some or all of the component elements of the 
care system of the above described embodiment 2 may 
be hardware, or may be software with the same func- 
tions as the corresponding functions of that hardware. 

20 [0133] Media include recording media such as ROM, 
transmission media such as the Internet, and light, elec- 
tric-wave, sound-wave, and similar transmission media. 
Holding media include, for example, recording media on 
which programs and/or data are recorded, transmission 

25 media that transmit programs and/or data, and so forth. 
[0134] "Capable of being processed by a computer 1 ' 
means, in the case of a recording medium such as ROM, 
for example, capable of being read by a computer, and 
in the case of a transmission media, that the program 

30 and/or data to be transmitted can be handled by a com- 
puter as the result of transmission. 

(Embodiment 3) 

35 [0135] Next, the configuration of a behavior determin- 
ing apparatus according to embodiment 3 will be de- 
scribed using FIGS. 7 and 8. 
[0136] FIG. 7 is a drawing for explaining the location 
of each component unit when the several component 

40 units configuring the behavior determining apparatus of 
embodiment 3 of the are installed in various locations in 
a residence, etc. FIG. 8 is a block diagram of the behav- 
ior determining apparatus of embodiment 3. 
[0137] As shown in FIG. 7, the behavior determining 

« apparatus of embodiment 3 is configured by CCD cam- 
eras 101a and 1 01 b, an infrared ray sensor 1 02, an in- 
bed state sensor 103, an air quality sensor 104, a toilet 
sensor 1 05, window open/close detectors 1 06 and 1 07, 
aTV power on/off detector 1 08, a refrigerator door open/ 

so close detector 109, a management unit 110, a PIT 111, 
a transmitter/receiver 112, and a loudspeaker 113. 
[0138] CCD camera 101a is installed on the ceiling of 
the kitchen 114 on the first floor of the residence, and is 
means for viewing the situation in the kitchen 114 area, 

55 while CCD camera 101b is installed on the ceiling of the 
first-floor living room 115, and is means for viewing the 
situation in the living room 115 area. The infrared ray 
sensor 1 02 is installed on the ceiling of the first-floor liv- 
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ing room 115 at the doorway dividing the kitchen 114 
from the living room 1 1 5, and is means for detecting hu- 
man movement between the kitchen 114 and the living 
room 115. The in-bed state sensor 103 is installed be- 
tween the support of the bed 1 1 7 located in the second- 
floor bedroom 1 1 6 and the floor on which the bed 1 1 7 is 
placed, and is means for detecting whether a person is 
in the bed 117 by detecting a load applied to the bed 
1 1 7. The air quality sensor 1 04 is installed on the ceiling 
of the kitchen 1 1 4, and is means for measuring the room 
humidity and concentration of volatile organic substanc- 
es and C0 2 , while the toilet sensor 105 is installed on 
the ceiling of the toilet 1 1 8, and is means for measuring 
the general position of a person who has entered the 
toilet 118, and the length of time spent there, using an 
infrared distance sensor. 

[0139J A window open/close detector 1 06 is installed 
on the window 119 in the bedroom 116, and is means 
for detecting whether the window 11 9 is open or closed. 
Similarly, a window open/close detector 107 is installed 
on the window 120 in the living room 115, and is means 
for detecting whether the window 120 is open or closed. 
The TV power on/off detector 1 08 is means for detecting 
whether the power of the TV 121 located in the living 
room 1 1 5 is on or off, by making use of the fact that the 
amount of current when the TV 1 21 is on is larger than 
when it is off, or by detecting whether the TV 121 is re- 
ceiving a remote controller switch signal, etc. The refrig- 
erator door open/close detector 109 is fitted to the re- 
frigerator 122 located in the kitchen 114, and is means 
for detecting whether the door is open or closed. 
[0140J The management unit 110 is installed within a 
wall of the living room 115, and as shown in FIG. 8, is 
configured by a first recording unit 123, a determining 
unit 124, an output unit 125, an input unit 126, a second 
recording unit 127, and a learning unit 128. 
[0141] The first recording unit 123 is means for re- 
cording the pattern of behavior of the resident of the res- 
idence in FIG. 7, and the pattern of action of devices 
installed in the residence. The determining unit 124 is 
means for comparing the actual behavior of the resident 
with the pattern of behavior recorded in the first record- 
ing unit 123, and determining whether the behavior of 
the resident is substantially identical to the pattern of 
behavior recorded in the first recording unit 123. More- 
over, the determining unit 124 is also means for com- 
paring the actual actions of devices with the pattern of 
action of devices recorded in the first recording unit 1 23, 
and determining whether device actions are substantial- 
ly identical to the pattern of action. 
[0142] In this embodiment, the actual behavior of the 
resident is detected by means of the CCD cameras 101a 
and 101b, infrared ray sensor 102, in-bed state sensor 
103, air quality sensor 104, toilet sensor 105, and PIT 
111. In addition, information received by the transmitter/ 
receiver 112 is also used for detection of the resident's 
behavior. Actual actions of devices in the present em- 
bodiment mean opening and closing actions for the win- 



dows 119 and 120 provided in the bedroom 116 and liv- 
ing room 1 1 5, power on/off actions for the TV 1 21 locat- 
ed in the living room 115, and opening and closing ac- 
tions for the door of the refrigerator 122 located in the 

5 kitchen 1 1 4, and these actions are detected, respective- 
ly, by the window open/close detector 106, window 
open/close detector 107, TV power on/off detector 1 08, 
and refrigerator door open/close detector 109. 
[01 43] The output unit 1 25 is means for outputting an 

10 alarm if the result of the determination by the determin- 
ing unit 124 is negative. The input unit 126 is means for 
inputting the resident's response to an alarm output by 
the output unit 125. The second recording unit 127 is 
means for temporarily recording the behavior of the res- 

15 ident detected by the CCD cameras 1 01 a and 1 01 b, in- 
frared ray sensor 1 02, in-bed state sensor 1 03, air qual- 
ity sensor 1 04, toilet sensor 1 05, PIT 1 1 1 , and transmit- 
ter/receiver 112. In addition, the second recording unit 
1 27 is means for temporarily recording window 1 1 9 and 

20 120 opening and closing actions, TV 121 power on/off 
actions, and refrigerator 122 door opening and closing 
actions, detected by the window open/close detector 
1 06, window open/close detector 1 07, TV power on/off 
detector 108, and refrigerator door open/close detector 

25 1 09. The learning unit 128 is means for controlling the 
operation of the first recording unit 123 and the second 
recording unit 127 as instructed, when the resident's re- 
sponse input by the input unit 126 is an instruction for 
the resident behavior or device actions temporarily re- 

30 corded in the second recording unit 1 27 to be addition- 
ally recorded in the first recording unit 1 23 as a new pat- 
tern, or an instruction for all or part of the pattern record- 
ed in the first recording unit 123 to be changed to part 
of the above described new pattern. 

35 [0144] The PIT 111 is a personal information terminal 
carried by the resident in FIG. 7, capable of transmitting 
and receiving information by electric wave, and incorpo- 
rates means for issuing by means of a weak electric 
wave an specification number, unique to the resident 

40 carrying the PIT 111 , for the purpose of specifying that 
resident when a given instruction by a electric wave from 
the transmitter/receiver 1 1 2 is received. The PIT 1 1 1 al- 
so incorporates means for receiving an alarm output by 
electric wave from the output unit 125 of the manage- 
rs ment unit 110, emitting sound, vibration, andlightbased 
on that alarm, and notifying the resident of the alarm. 
The PIT 111 is also means for inputting the resident's 
response when an alarm is issued, and transmitting that 
response by electric wave. 

50 [0145] In addition, the PIT 111 has a gyro sensor, ac- 
celeration sensor, and angle sensor, and is also means 
for detecting the attitude of the carrier (standing, sitting, 
prone, etc.). The PIT 111 also has a function for detect- 
ing a moving state and the amount of activity, and further 

55 incorporates functions that allow detection of the phys- 
iological state of the carrier (heart rate, body tempera- 
ture, etc.). Information transmission and reception by 
the PIT 1 1 1 is performed by means of PHS system com- 
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munication or by means of specific low-power commu- 
nication using a frequency band of several hundred 
MHz. In FIG. 8, two PITS are shown, but these two PITs 
are the same unit; two PITs are shown for the sake of 
explanation, since there are a plurality of PIT 111 func- 
tions. 

[01 46] The transmitter/receiver 1 1 2 is installed on the 
ceiling at the entrance/exit dividing the kitchen 1 1 4 from 
the living room 115, touching the infrared ray sensor 

102, and is means for enabling electric-wave transmis- 
sion and reception of information, and means for spec- 
ifying the person who moved when information is input 
indicating that human movement has been detected 
from the infrared ray sensor 102. 

[0147] The loudspeaker 113 is means for issuing a 
warning sound on the basis of an alarm output by the 
output unit 125 of the management unit 110. 
[0148] In embodiment 3, the CCD cameras 101 a and 
101b, infrared ray sensor 102, in-bed state sensor 103, 
air quality sensor 104, toilet sensor 105, PIT 111, and 
transmitter/receiver 112 are used as an example of the 
detecting means of the behavior determining apparatus 
claim 21. Also, the window open/close detectors 106 
and 1 07, TV power on/off detector 1 08, and refrigerator 
door open/close detector 109 are used as an example 
of the detecting means of the behavior determining ap- 
paratus. 

[0149] In embodiment 3, the first recording unit 123 
within the management unit 110 is used as an example 
of the recording means, and the determining unit 124 
within the management unit 110 as an example of de- 
termining means, respectively, of the behavior deter- 
mining apparatus. Also, the output unit 125 within the 
management unit 1 1 0, the PIT 1 1 1 , and the speaker 1 1 3 
is used as an example of the notifying means of the be- 
havior determining apparatus. Further, the input unit 1 26 
is used as an example of the input means of the behavior 
determining apparatus. 

[0150] In embodiment 3, the second recording unit 
127 is used as an example of the second recording 
means, and the learning unit 128 as an example of the 
learning means, respectively, of the behavior determin- 
ing apparatus. 

[01 51 ] Also, the transmitter/receiver 1 1 2 is used as an 
example of the first transmitting/recording means of the 
behavior determining apparatus and the second trans- 
mitting/recording unit is provided in the PIT 111. 
[0152] Next, the operation of the behavior determin- 
ing apparatus according to embodiment 3 will be de- 
scribed. 

[0153] First, regarding the resident, the behavior of 
the subject resident detected by the CCD cameras 101a 
and 101b, infrared ray sensor 102, in-bed state sensor 

103, air quality sensor 104, toilet sensor 105, PIT 111, 
and transmitter/receiver 112, is recorded in the first re- 
cording unit 123 of the management unit 110. Similarly, 
when the resident causes actions to be recorded in the 
first recording unit 123, window 119 and 120 opening 



and closing actions, TV 121 power on/off actions, and 
refrigerator 122 door opening and closing actions, de- 
tected by the window open/close detectors 1 06 and 1 07, 
TV power on/off detector 108, and refrigerator door 
5 open/close detector 1 09, are recorded in the first record- 
ing unit 123. 

[0154] Here, for the purposes of the following expla- 
nation, recording of the behavior of the above described 
subject resident, and window 119 and 120 opening and 

10 closing actions, TV 121 power on/off actions, and refrig- 
erator 122 door opening and closing actions, in the first 
recording unit 1 23, is assumed to have been performed 
continuously throughout the year 1998. It is also as- 
sumed that the resident behavior recorded in the first 

15 recording unit 123 has been averaged for each month, 
and recorded beforehand in the first recording unit 123 
as the behavior patterns of the subject resident. Simi- 
larly, it is assumed thatwindow 1 1 9 and 1 20 opening and 
closing actions, TV 121 power on/off actions, and refrig- 

20 erator 1 22 door opening and closing actions have been 
averaged for each month, and recorded beforehand in 
the first recording unit 123 as device action patterns. 
[0155] Therefore, in this embodiment, the first record- 
ing unit 123 has recorded averaged the subject resi- 

25 dent's behavior patterns and the device action patterns 
for each month of 1998. Here, the behavior pattern for 
July 1 998 recorded in the first recording unit 1 23 is taken 
as pattern 1 , and the device action pattern as pattern 2, 
and FIG. 9 shows the part of pattern 1 from 8 a.m. to 3 

30 p.m., while FIG. 10 shows the part of pattern 2 from 8 
a.m. to 3 p.m. 

[0156] First, the part of pattern 1 will be described. As 
shown in FIG. 9, from 8 a.m. to 9:30 a.m. in pattern 1, 
the resident is determined to be in the kitchen 114 from 

35 the fact that the figure of the resident is included in the 
view of the kitchen 114 shot by the CCD camera 101 a, 
and the C0 2 concentration in the kitchen 114 measured 
by the air quality sensor 1 04 has exceeded a given 
threshold level, and this is recorded in the first recording 

40 unit 123. When a person is in the kitchen 114, the C0 2 
concentration in the kitchen 1 1 4 rises, and therefore the 
air quality sensor 1 04 can detect whether a person is in 
the kitchen 114 by measuring the concentration of C0 2 
in the kitchen 1 1 4. Also, if the person in the kitchen 1 1 4 

45 is cooking, the humidity, C0 2 concentration, and con- 
centration of volatile organic constituents increase, and 
therefore the air quality sensor 104 can detect whether 
a person is in the kitchen 1 14 by measuring some or all 
of these parameters-humidity, C0 2 concentration, and 

so concentration of volatile organic constituents-in the 
kitchen 114. 

[0157] Then, at 9:30 a.m., the fact that the resident 
has left the kitchen 1 1 4 and entered the living room 1 1 5 
is detected from the fact that the infrared ray sensor 1 02 
55 has detected human movement and the figure of the 
resident has disappeared from the view of the kitchen 
114 shot by the CCD camera 101 a, as well as from the 
fact that the C0 2 concentration in the kitchen 1 1 4 meas- 
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ured by the air quality sensor 104 has fallen below the 
given threshold level, and that the figure of the resident 
has appeared in the view of the living room 115 shot by 
the CCD camera 101b, and this has been recorded in 
the first recording unit 123. Then, from 9:30 to 11 :00, the 
resident remains within the view of the living room 115 
shot by the CCD camera 1 01 b, and so the fact that the 
resident is in the living room 115 is thus detected, and 
is recorded in the first recording unit 123. 
[0158] At 11 a.m., the infrared ray sensor 102 again 
detects human movement and the figure of the resident 
is included in the view of the kitchen 114 shot by the 
CCD camera 101a, in addition to which the humidity, 
C0 2 concentration, and concentration of volatile organic 
constituents in the kitchen 1 1 4 measured by the air qual- 
ity sensor 104 exceed the given threshold level, as a 
result of which the resident is detected to be in the kitch- 
en 114, and this is recorded in the first recording unit 
123. 

[0159] At 12 noon, due to detection of an infrared ray 
again by the infrared ray sensor 102, etc., the fact that 
the resident has left the kitchen 1 1 4 and entered the liv- 
ing room 115 is recorded in the first recording unit 123. 
Then, from 2 p.m. to 3 p.m., the fact that the resident is 
in bed 117 is detected through detection by the in-bed 
state sensor 103 of a load applied to the bed 117, and 
this is recorded in the first recording unit 123. 
[01 60] As stated above, pattern 1 is the averaged be- 
havior pattern for July 1998. 

[01 61 ] Also, when the resident moves from the kitch- 
en 114 to the living room 115, or from the living room 
1 15 to the kitchen 114, human movement is detected by 
the infrared ray sensor 1 02, and in this case the infrared 
ray sensor 1 02 outputs information to the effect that hu- 
man movement has been detected to the transmitter/ 
receiver 112. The transmitter/receiver 112 then trans- 
mits to the PIT 111 , by means of an electric wave with 
a high degree of directivity for a restricted area, an in- 
struction for issuing an specification number to specify 
the person carrying the PIT 111. On receiving the in- 
struction, the PIT 111 issues by means of an electric 
wave an specification number to specify the person car- 
rying the PIT 111, and, based on the specification 
number from the PIT 111 , the transmitter/receiver 112 
specifies the person who emitted the infrared ray detect- 
ed by the infrared ray sensor 1 02. By means of this spec- 
ification, the identity of the person who moved from the 
kitchen 1 1 4 to the living room 1 1 5, or from the living room 
115 to the kitchen 114, is ascertained. 
[0162] This kind of specification method can be used 
when a number of people are living in the same resi- 
dence, to specify who moved between adjacent rooms, 
or who moved either way between a room and adjacent 
passageway Also, to specify who moved either way be- 
tween a room and adjacent passageway, means, such 
as the above described transmitter/receiver 112, must 
be installed on the ceiling at the junction of the room and 
passageway, for example, for specifying who moved ei- 



ther way between the room and adjacent passageway 
based on an specification number from the PIT 111 . 
[0163] Next, the part of pattern 2 will be described. As 
shown in FIG. 10, from 8 a.m. to 3 p.m., window open/ 

5 close detector 106 detects that the window 119 is 
closed, while window open/close detector 107 detects 
that the window 120 is open from 9:30 a.m. to 10 a.m. 
and from 1:30 p.m. to 2 p.m., and is closed at other 
times, and these facts are recorded in the first recording 

io unit 123. 

[01 64] The TV power on/off detector 1 08 detects the 
TV 121 power to be on from 9:30 a.m. to 11 a.m. and 
from 12 noon to 1:30 p.m., and to be off at other times, 
and these facts are recorded in the first recording unit 

*s 1 23. The refrigerator door open/close detector 1 09 de- 
tects that the door of the refrigerator 1 22 was repeatedly 
opened and closed intermittently between 8 a.m. and 8: 
10 a.m., and between 11 a.m. and 11:10 a.m., and was 
closed at other times, and these facts are recorded in 

20 the first recording unit 123 as part of pattern 2. 

[0165] As stated above, pattern 2 is the averaged de- 
vice action pattern for July 1998. 
[0166] Next, the operation of the behavior determin- 
ing apparatus of embodiment 3 after pattern 1 and pat- 

25 tern 2 have been recorded in the first recording unit 1 23 
will be described using the flowchart in FIG. 1 1 . For pur- 
poses of explanation, the operation of the behavior de- 
termining apparatus of embodiment 3 for July 22, 1 999, 
will be described. 

30 [0167] The behavior of the resident on this July 22 is 
detected by the CCD cameras 1 01 a and 101 b, infrared 
ray sensor 102, in-bed state sensor 103, air quality sen- 
sor 104, toilet sensor 105, and PIT 111, and the detec- 
tion data of each is input to the determining unit 124 

35 shown in FIG. 8 (step 101). In addition, information on 
the person carrying the PIT 111, specified by the trans- 
mitter/receiver 1 12, is also input to the determining unit 
124 (step 101). 

[01 68] July 22 window 1 1 9 and 1 20 opening and clos- 
40 ing actions, TV 121 power on/off actions, and refrigera- 
tor 122 door opening and closing actions, are detected, 
respectively, by the window open/close detectors 106 
and 107, TV power on/off detector 108, and refrigerator 
door open/close detector 1 09, and the detection data of 
45 each is input to the determining unit 124 (step 102). 
[0169] Each kind of data input to the determining unit 
1 24 is also input to the second recording unit 1 27, where 
it is recorded and stored temporarily. 
[0170] Next, the determining unit 1 24 also inputs pat- 
so tern 1 and pattern 2 recorded in the first recording unit 
123 (steps 103 and 104), and determines whether the 
resident's behavior is identical with pattern 1 within a 
given time period or within a given range of behavior 
(step 105). Similarly, the determining unit 124 deter- 
55 mines whether device actions are identical with pattern 
2 within a given time period or within a given range of 
actions (step 106). Then, if the result of the determina- 
tion by the determining unit 1 24 is that the resident's be- 



37 



EP 1 071 055 B1 



38 



havior is not identical with pattern 1 within a given time 
period or within a given range of behavior, or that device 
actions are not identical with pattern 2 within a given 
time period or within a given range of actions, the output 
unit 125 outputs an alarm (step 107). The operation of 
the behavior determining apparatus of embodiment 3 af- 
ter the output unit 1 25 outputs an alarm will be described 
below together with an actual example. 
[0171] To take an actual example for the purpose of 
explanation, it will be assumed that the resident visits 
the hospital on the same day each week starting from 
July 22, and that he/she leaves home at 9 a.m. to go to 
the hospital. The resident goes to the kitchen 114 at 8 
a.m. and prepares breakfast, finishes breakfast at 8:30 
a.m. , and enters the living room 115. The resident opens 
and closes the refrigerator 122 intermittently between 8 
a.m. and 8:10 a.m. Looking at device actions from 8 a. 
m. to 9 a.m., since the actual device actions detected 
by the refrigerator door open/close detector 109 are 
identical with pattern 2 recorded in the first recording 
unit 123, the determining unit 124 determines that the 
device actions are identical with pattern 2. Therefore, 
the output unit 125 does not output an alarm. 
[0172] Meanwhile, looking at the behavior of the res- 
ident during that same period of 8 a.m. to 9 a.m., since 
the actual behavior of the resident is not identical with 
pattern 1 recorded in the first recording unit 123, the de- 
termining unit 124 determines that the actual behavior 
of the resident detected by the CCD camera 1 01 a, etc., 
is not identical with pattern 1 . Therefore, the output unit 
1 25 outputs an alarm to the PIT 1 1 1 and the loudspeaker 
113. The output unit 125 is assumed to transmit the 
alarm by electric wave to the PIT 1 11 . Then, when the 
PIT 111 receives the alarm by electric wave, it emits 
speech, vibration, and light on the basis of that alarm, 
notifying the resident of the alarm. The loudspeaker 1 1 3 
also emits a warning sound. When warned in this way, 
the resident stops the alarm. 
[0173] The resident usually visits the hospital on the 
same day each week starting from July 22, and since 
the resident's behavior on the day of the hospital visit 
differs from pattern 1 , and the device actions associated 
with the resident's behavior also differ from pattern 2, it 
is assumed that the resident wishes to record the resi- 
dent behavior and device actions on July 22 in the first 
recording unit 123 as new patterns. In this case, the res- 
ident inputs an instruction to perform additional record- 
ing of the behavior and device actions of July 22 in the 
first recording unit 123 as new patterns. The PIT 111 
transmits the instruction received from the resident to 
the input unit 1 26 of the management unit 1 1 0 by electric 
wave, and the input unit 126 inputs the resident's in- 
struction transmitted from the PIT 111 (step 108), and 
outputs it to the learning unit 128. 
[0174] Now, since the second recording unit 1 27 tem- 
porarily records the resident's behavior and device ac- 
tions of July 22, as described above, the resident's be- 
havior and device actions temporarily recorded in the 



second recording unit 127 are additionally recorded by 
the learning unit 128 in the first recording unit 123 as 
part of a new pattern, based on the resident's instruction 
input by the input unit 1 26 (step 1 09). Afterthe resident's 

5 behavior and device actions of July 22 have been tem- 
porarily recorded in the second recording unit 127, fol- 
lowing input of the resident's instruction by the input unit 
126, these are also recorded sequentially by the learn- 
ing unit 1 28 in the first recording unit 1 23 as the remain- 

10 ing part of the new pattern. 

[01 75] As the resident's response to an alarm is input 
to the input unit 126 in this way, and control is performed 
so that a new pattern is recorded in the first recording 
unit 123 on the basis of that response, an alarm is not 

is issued even if the resident's behavior on July 22 after 
input of the response by the input unit 126 and pattern 
1 are not substantially identical, and an alarm is not is- 
sued if the resident shows substantially the same be- 
havior as the July 22 behavior after the new pattern has 

20 been recorded in the first recording unit 1 23-or to be ex- 
act, from July 23 onward. 

[0176] In embodiment 3, if the detected behavior of 
the resident and behavior corresponding to pattern 1 dif- 
fer only within a time period of 10 minutes or less, the 
25 detected resident's behavior is regarded as being iden- 
tical with pattern 1 . 

[0177] In the description thus far, an alarm is issued 
because the actual behavior of the resident is not iden- 
tical with pattern 1 , and as the response to that alarm, 

30 the input unit 1 26 inputs an instruction for recording the 
behavior and device actions of July 22, sent from the 
PIT 111 by electric wave, in the first recording unit 123 
as a new pattern. However, the resident's response in- 
put by the input unit 126 may also be an instruction for 

35 replacing the part of pattern 1 and/or pattern 2 from 8 a. 
m. to 1 p.m. with that part of the July 22 behavior and 
device actions from 8 a.m. to 1 p.m., and recording the 
result in the first recording unit 1 23. Also, the resident's 
response input by the input unit 126 may also be an in- 

40 struction for deleting pattern 1 and pattern 2 recorded 
in thefirst recording unit 1 23, and recording the behavior 
and device actions of July 22 in the first recording unit 
123 as a new pattern 1 or pattern 2, respectively. In any 
case, the learning unit 1 28 controls the operation of the 

45 first recording unit 123 and the second recording unit 
127 on the basis of the response input by the input unit 
126. 

[0178] In the description thus far, an alarm is issued 
because the actual behavior of the resident is not iden- 

50 tical with pattern 1 , but an alarm is also issued if the 
actual device actions are not identical with pattern 2. In 
this case, too, the resident responds to that alarm and 
the input unit 126 inputs that response. Then, based on 
that response, the learning unit 128 controls the opera- 

55 tion of the first recording unit 123 and the second re- 
cording unit 127 as described above. 
[0179] As explained above, the behavior determining 
apparatus of embodiment 3 outputs an alarm if a pattern 
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recorded beforehand in the first recording unit 1 23, and 
the actual behavior of the subject person or device ac- 
tions, are not substantially identical, and the subject per- 
son's response to that alarm can be input. Also, based 
on that response, the subject person's behavior and de- 
vice actions that are not substantially identical to the pat- 
terns are additionally recorded in the first recording unit 
123 as new patterns, or recorded in the first recording 
unit 123, replacing some or all of the patterns already 
recorded in the first recording unit 123. 
[0180] In the above described embodiment 3, the 
case has been described where the component units of 
the behavior determining apparatus are located in vari- 
ous places in a residence, etc., but the component units 
of the behavior determining apparatus are not restricted 
to only location in various places in a residence, etc., 
but may also be located in a hospital or care facility, for 
example. In this case, if a pattern recorded in the first 
recording unit 123 and the actual behavior of the subject 
person or device actions are not substantially identical, 
the output unit 125 can notify information to that effect 
to the hospital nurses' room or other administration sec- 
tion, either directly or via another device. In this way, a 
nurse or other member of the administration can accu- 
rately ascertain the behavior of the subject person. 
[01 81 ] Also, while a hospital or care facility has many 
subject persons, each subject person has transmitting 
means, such as the second transmitter/receiver provid- 
ed in the above described PIT 111, for transmitting by 
electric wave an specification number that is unique to 
the subject person carrying the PIT 111 and is used to 
specify that subject person, or detecting means for de- 
tecting human movement, such as an infrared ray sen- 
sor, when the above described PIT 1 1 1 is carried, where- 
by the detected person is specified. If the subject person 
lives alone, for example, and the component units of the 
behavior determining apparatus are installed in that per- 
son's residence, as there is only one subject person, jt 
is not necessary to provide the PIT 111 with means for 
specifying the person carrying that PIT 1 1 1 . In this case, 
the output unit 125 will output information to an admin- 
istration center, etc., for providing care for the subject 
person, such as a public welfare facility, and the behav- 
ior of the subject person will be managed by the public 
welfare facility, etc. 

[0182] In the above described embodiment 3, the 
CCD cameras 101a and 101b, Infrared ray sensor 102, 
in-bed state sensor 103, air quality sensor 104, toilet 
sensor 105, PIT 111, and transmitter/receiver 112 are 
used as an example of the detecting means of the be- 
havior determining apparatus; however, the detecting 
means of the behavior determining apparatus is not lim- 
ited to the above described CCD cameras 101 or infra- 
red ray sensor 102. The detecting means may be any 
means of detecting the behavior of the subject person. 
Moreover, the attitude, movement state, and degree of 
activity of the subject person are also applicable as be- 
havior of the subject person. 



[0183] In the above described embodiments, the win- 
dow open/close detectors 106 and 107, TV power on/ 
off detector 1 08, and refrigerator door open/close detec- 
tor 1 09 are used as an example of the detecting means 

5 of the behavior determining apparatus; however, the de- 
tecting means is not limited to the above described win- 
dow open/close detector 106 and TV power on/off de- 
tector 108. The detecting means may be any means of 
detecting the actions of the relevant devices. 

10 [01 84] In the above described embodiment 3, the res- 
ident Inputs the response to an alarm to the PIT 1 1 1 , and 
the input unit 126 inputs the resident's response from 
the PIT 1 1 1 by electric wave; however, it is also possible 
for the resident to input responses to a special response 

15 input device, and for the input unit 1 26 to input the res- 
ident's responses via that special response input de- 
vice. In short, the input unit 1 26 need only input the res- 
ident's responses. 

[0185] In the above described embodiment 3, on re- 

20 ceiving a given instruction from the transmitter/receiver 
112, the PIT 111 transmits by electric wave an specifi- 
cation number to specify the person carrying the PIT 
111; however, it is also possible for the transmitter of the 
PIT 111, etc., to transmit an specification number by 

25 electric wave, regularly or irregularly, to specify an indi- 
vidual resident, regardless of whether or not a given in- 
struction is received from the transmitter/receiver 112. 
[0186] In the above described embodiment 3, the 
transmitter/receiver 112 specifies the person carrying 

30 the PIT 11 1 ; however, it is also possible for some or all 
of the CCD cameras 1 01 a and 101b, infrared ray sensor 
1 02, in-bed state sensor 1 03 , air quality sensor 1 04, and 
toilet sensor 105 to have a function for specifying the 
person carrying the PIT 11 1 , and for the person carrying 

35 the PIT 111 to be specified using an specification 
number transmitted by electric wave from the PIT 111 . 
[0187] In the above described embodiment 3, the first 
recording unit 123 records pattern 1 and pattern 2; how- 
ever, the first recording unit 123 need only record one 

40 or a plurality of the subject person's behavior patterns 
and device action patterns. It is also possible to use 
means for recording one or a plurality of the subject per- 
son's behavior patterns only, and means for recording 
one or a plurality of device action patterns only, instead 

45 of the first recording unit 123. Also, the above mentioned 
first recording unit 123, is not limited to a unit that 
records the average patterns for each month of the year 
1998, but may also record detection data for only one 
month as a pattern, or may also record averaged detec- 

50 tion data for one month, or detection data for one month 
averaged for each day of the week, as a pattern. In short, 
all that is required is for means for recording one or a 
plurality of the subject person's behavior patterns, and 
means for recording one or a plurality of device action 

55 patterns, to be provided. 

[0188] Also, the determining unit 124 need only com- 
pare one or a plurality of behavior patterns recorded by 
the first recording unit 123 with the actual behavior of 
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the subject person, and determine whether or not the 
actual behavior of the subject person is substantially 
identical with any of the subject person's behavior pat- 
terns. And the determining unit 124 need only compare 
one or a plurality of device action patterns recorded by 
the first recording u nit 1 23 with the actual device actions, 
and determine whether or not the actual device actions 
are substantially identical with any of the device action 
patterns. 

[01 89] The above expression "substantially identical" 
refers to the case where the subject person's behavior 
or device actions are identical with a pattern within a 
given time period of up to ten minutes, for example, or 
where, for example, since the subject person's behav- 
iors of standing, and of bending down , in the kitchen 1 1 4 
are both the same in terms of the subj ect person's being 
in the kitchen 114, the subject person's behavior and 
device actions are identical with a pattern within a given 
subject person behavior range or a given device action 
range of this kind, 

[0190] In the above described embodiment 3, when 
the resident's behavior is determined by the determining 
unit 124 not to be substantially identical to pattern 1 , the 
loudspeaker 113 emits a warning sound; however, an 
alarm lamp that displays an alarm by means of an optical 
signal may be used instead of the loudspeaker 113. In 
short, all that is required is for an alarm to be output 
when the resident's behavior or device actions are not 
substantially identical to any pattern recorded in the first 
recording unit 123. 

[0191] In the above described embodiment 3, the de- 
termining unit 124 determines whether or not the subject 
person's behavior is substantially identical to any of the 
patterns recorded in the first recording unit 123, or 
whether or not device actions are substantially identical 
to any of the patterns recorded in the first recording unit 
123; however, the determining unit 124 may also deter- 
mine whether or not a combination of some or all of the 
subject person's behavior, device actions, subject per- 
son's physiological state, and subject person's psycho- 
logical state, are substantially identical to any of the pat- 
terns recorded in the first recording unit 1 23. In this case, 
the patterns recorded in the first recording unit 1 23 must 
be patterns comprising a combination of some or all of 
the subject person's behavior, device actions, subject 
person's physiological state, and subject person's psy- 
chological state. Also, detecting means for detecting the 
physiological state and/or psychological state of the 
subject person must be provided. 
[01 92] As means for detecting the physiological state 
of the subject person, it is possible to use, for example, 
a thermometer that measures the body temperature of 
the subject person, a perspiration meter that measures 
the amount of perspiration produced by the subject per- 
son, and a heart rate meter that measures the heart rate 
of the subject person. As mentioned above, the PIT 111 
incorporates functions that allow detection of the phys- 
iological state of the subject person (heart rate, body 



temperature, etc.), and therefore all that is required is 
for physiological information such as the heart rate and 
body temperature of the subject person to be transmit- 
ted by electric wave, regularly or irregularly, to that PIT 

5 111 , and for the transmitter/receiver 1 1 2 to receive that 
electric wave. This physiological information is then in- 
put to the determining unit 124. The physiological infor- 
mation can be input directly to the determining unit 124 
by the subject person himselffterself or by a care-giver. 

10 As the means for detecting the psychological state of 
the subject person, some or all of the above mentioned 
instruments-thermometer, perspiration meter, and heart 
rate meter-and psychological state determining unit that 
determines changes in the psychological state based on 

is changes in body temperature, amount of perspiration, 
and heart rate, etc., can be used. 
[0193] In this way, some or all of the subject person's 
behavior, device actions, subject person's physiological 
state, and subject person's psychological state are de- 

20 tected by the individual detecting means, and a combi- 
nation of the subject person's behavior and some or all 
of device actions, subject person's physiological state, 
and subject person's psychological state is recorded be- 
forehand in the first recording unit 123 as-a pattern. 

25 Then, all that is required is to allow the determining unit 
124 to determine whether or not a combination of the 
actual subject person's behavior and some or all of de- 
vice actions, subject person's physiological state, and 
subject person's psychological state, is substantially 

30 identical to the pattern. If the result of this determination 
is non-identity, the output unit 125 outputs an alarm. 
Then the input unit 126 inputs the subject person's re- 
sponse to that alarm. 

[0194] If a combination of the detected subject per- 
35 son's behavior and some or all of device actions, subject 
person's physiological state, and subject person's psy- 
chological state is temporarily stored in the second re- 
cording unit 127, it is possible to additionally record new 
patterns in the first recording unit 123 according to the 
40 content of the response input to the input unit 1 26, and 
it is also possible to change part or all of the patterns 
already recorded. 

[0195] In the detecting means for detecting the sub- 
ject person's physiological state and/or the subject per- 

45 son's psychological state, it is also possible to set a func- 
tion that specifies the subject person using information 
via electric wave for specifying subject persons, and a 
function that enables the physiological state and/or psy- 
chological state of that person to be detected, as with 

50 the CCD cameras 101 , infrared ray sensor 102, in-bed 
state sensor 1 03, air quality sensor 1 04, or toilet sensor 
105. Also, as mentioned above, the PIT 111 can be used 
as an example of the detecting means for detecting the 
subject person's physiological state and/or the subject 

55 person's psychological state. 

[0196] Also, some or all of the component elements 
of the behavior determining apparatus of the above de- 
scribed embodiment 3 may be hardware, or may be soft- 
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ware with the same functions as the corresponding func- 
tions of that hardware. 

(Embodiment 4) 

[01 97] Next, the configuration of a behavior determin- 
ing apparatus according to embodiment 4 will be de- 
scribed using FIGS. 7 and 12. 
[0198] FIG. 7 is a drawing for explaining the location 
of each component unit when the several component 
units configuring the behavior determining apparatus of 
embodiments, as described above, are installed in var- 
ious locations in a residence, etc. As explained later, 
some of the component units configuring the behavior 
determining apparatus of embodiment 4 are the same 
as some of the component units configuring the behav- 
ior determining apparatus of embodiment 3, and there- 
fore FIG. 7 will also be used when describing the behav- 
ior determining apparatus of embodiment 4. FIG. 12 is 
a block diagram of the behavior determining apparatus 
of embodiment 4. 

[0199] As shown in FIG. 12, the behavior determining 
apparatus of embodiment 4 is configured by CCD cam- 
eras 101a and 101b, an infrared ray sensor 102, an in- 
bed state sensor 1 03, an air quality sensor 1 04, a toilet 
sensor 1 05, window open/close detectors 1 06 and 1 07, 
a TV power on/off detector 1 08, a refrigerator door open/ 
close detector 109, a management unit 129, a PIT 111 , 
a transmitter/receiver 112, and a loudspeaker 113. The 
CCD cameras 1 01 a and 1 01 b, infrared ray sensor 1 02, 
in-bed state sensor 103, air quality sensor 104, toilet 
sensor 1 05, window open/close detectors 1 06 and 1 07, 
TV power on/off detector 108, refrigerator door open/ 
close detector 109, PIT 111, transmitter/receiver 112, 
and loudspeaker 113 are identical to the corresponding 
component units configuring the behavior determining 
apparatus of embodiment 3 described using FIGS. 7 
and 8. 

[0200] As with the management unit 1 1 0 of the behav- 
ior determining apparatus of embodiment 3, the man- 
agement unit 129 is installed within a wall of the living 
room 115 in FIG. 7, and as shown in FIG. 12, is config- 
ured by a first recording unit 130, an specifying unit 131 , 
a determining unit 132, an output unit 133, an input unit 
134, a second recording unit 135, and a learning unit 
136. 

[0201] The first recording unit 130 is means for re- 
cording patterns in the same way as the first recording 
unit 1 23 described in embodiment 3. These patterns are 
precise resident behavior patterns. The specifying unit 
131 is means for accurately specifying the behavior of 
the resident on the basis of resident behavior detected 
by the CCD cameras 1 01 a and 1 01 b, infrared ray sensor 
1 02, in-bed state sensor 1 03, air quality sensor 1 04, and 
toilet sensor 1 05, and device actions detected by the 
window open/close detectors 106 and 107, TV power 
on/off detector 1 08, and refrigerator door open/close de- 
tector 109, The determining unit 132 is means for com- 



paring the exact behavior of a resident specified by the 
specifying unit 131 with a pattern recorded in the first 
recording unit 130, and determining whether the exact 
behavior of the specified resident is substantially iden- 

5 tical to the pattern. 

[0202] The output unit 1 33 is means for outputting an 
alarm if the result of the determination by the determin- 
ing unit 132 is negative. The input unit 134 is means for 
inputting the resident's response to an alarm output by 

10 the output unit 133. The second recording unit 135 is 
means for temporarily recording the exact behavior of 
the resident specified by the specifying unit 131. The 
learning unit 136 is means for controlling the operation 
of the first recording unit 130 and the second recording 

15 unit 135 as instructed, when the resident's response in- 
put by the input unit 134 is an instruction for the resi- 
dent's exact behavior temporarily recorded in the sec- 
ond recording unit 135 to be additionally recorded in the 
first recording unit 1 30 as a new pattern, or an instruction 

20 for all or part of the pattern recorded in the first recording 
unit 130 to be changed to part of the above described 
new pattern. 

[0203] In embodiment 4, the CCD cameras 1 01 a and 
101b, infrared ray sensor 102, in-bed state sensor 103, 

25 air quality sensor 104, toilet sensor 105, PIT 111, and 
transmitter/receiver 11 2 are used as an example of the 
first detecting means of the behavior determining appa- 
ratus. Also, the window open/close detectors 106 and 
1 07, TV power on/off detector 1 08, and refrigerator door 

30 open/close detector 1 09 are used as an example of the 
second detecting means of the behavior determining 
apparatus. 

[0204] lnembodiment4,thespecifyingunit131 within 
the management unit 129 is used as an example of the 

35 specifying means, the first recording unit 130 within the 
management unit 129 as an example of the recording 
means, the determining unit 1 32 within the management 
unit 129 as an example of the determining means, the 
output unit 1 33 within the management unit 1 29 and the 

40 PIT 1 11 as an example of the notifying means, and the 
input unit 1 34 as an example of the input means, respec- 
tively, of the behavior determining apparatus. 
[0205] In embodiment 4, the second recording unit 
135 is used as an example of the second recording 

45 means, and the learning unit 1 36 as an example of the 
learning means, respectively, of the behavior determin- 
ing apparatus. 

[0206] As can be see by comparing FIG. 12 and FIG. 
8, with the exception of differences between the config- 

50 uration and operation of the management unit 1 29 of the 
behavior determining apparatus of embodiment 4 and 
the configuration and operation of the management unit 
110 of the behavior determining apparatus of embodi- 
ment 3, the behavior determining apparatus of embod- 

55 jment 4 is identical to the behavior determining appara- 
tus of embodiment 3, and therefore in describing the op- 
eration of the behavior determining apparatus of em- 
bodiment 4 shown below, the description will mainly cov- 
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er the differences from embodiment 3. 
[0207] Next, the operation of the behavior determin- 
ing apparatus according to embodiment 4 will be de- 
scribed. 

[0208] In embodiment 3, as shown in FIG. 8, the de- 
termining unit 124 determines whether or not the resi- 
dent's behavior detected by the CCD cameras 101a and 
101b, infrared ray sensor 102, in-bed state sensor 103, 
air quality sensor 104, toilet sensor 105, PIT 111, and 
transmitter/receiver 112 is substantially identical to pat- 
tern 1 recorded in the first recording unit 123, and also 
determines whether or not the actions comprising win- 
dow 119 and 120 opening and closing actions, TV 121 
power on/off actions, and refrigerator 1 22 door opening 
and closing actions, detected by the window open/close 
detectors 106 and 107, TV power on/off detector 108, 
and refrigerator door open/close detector 109, are sub- 
stantially identical to pattern 2 recorded in the first re- 
cording unit 123. 

[0209] In contrast to this, in embodiment 4, as shown 
in FIG. 12, the determining unit 132 determines whether 
or not the exact behavior of the resident specified by the 
specifying unit 131 and a pattern recorded in the first 
recording unit 130 are substantially identical. That is to 
say, a pattern of the exact behavior of the resident is 
recorded in the first recording unit 130, and the specify- 
ing unit 1 31 specifies the exact behavior of the resident. 
[0210] First, the pattern of exact behavior of the resi- 
dent recorded in the first recording unit 130 will be de- 
scribed. For purposes of explanation, it is assumed that 
part of the resident's exact behavior pattern recorded in 
the first recording unit 130 is the pattern shown in FIG. 
13. The pattern shown in FIG. 13 corresponds to FIGS. 
9 and 10 used with embodiment 3, and is a pattern of 
the exact behavior of the resident, specified from the hu- 
man behavior in FIG. 9 and the device actions in FIG. 10. 
[021 1 ] To describe the content of the pattern in order, 
in the period from 8 a.m. to 9:30 a.m., according to the 
human behavior in FIG. 9 a person is in the kitchen., 
and according to the device actions in FIG. 10 the re- 
frigerator door is opened and closed intermittently dur- 
ing a ten-minute period from 8 a.m.; therefore, the pat- 
tern for 8:00 to 9:30 is "eating in the kitchen." Next, from 
9:30 to 11 :00, according to the human behavior in FIG. 
9 a person is in the living room, and according to the 
device actions in FIG. 10 the TV power is on; therefore, 
the pattern for 9:30 to 1 1 :00 is "watching TV in the living 
room. 

[0212] Then, from 11 a.m. to 12 noon, according to 
the human behavior in FIG. 9 a person is in the kitchen, 
and according to the device actions in FIG. 10 the re- 
frigerator door is opened and closed intermittently dur- 
ing a ten-minute period from 11 :00.; therefore, the pat- 
tern for 11:00 to 12:00 is "eating in the kitchen." Next, 
from 1 2 noon to 2 p.m., according to the human behavior 
in FIG. 9 a person is in the living room, and according 
to the device actions in FIG. 1 0 the TV power is on from 
1 2:00 to 1 :30, and the window 120 is open from 1 :30 to 



2:00; therefore, the pattern for 12: 00 to 1 :30 is "watch- 
ing TV in the living room," and the pattern for 1 :30 to 2: 
00 is "resting in the living room. "Lastly, from 2 to 3 p. 
m., according to the human behavior in FIG. 9 a person 
5 is lying on the bed, and therefore the pattern for 2:00 to 
3:00 is "in bed." 

[0213] Next, the operation of the behavior determin- 
ing apparatus of embodiment 4 after the resident's exact 
behavior pattern has been recorded in the first recording 
10 unit 130 will be described. As with embodiment 3, for 
purposes of explanation, the operation of the behavior 
determining apparatus of embodiment 4 for July 22, 
1999, will be described. 

[021 4] As described in embodiment 3, the behavior of 
15 the resident on this July 22 is detected by the CCD cam- 
eras 101a and 101b, infrared ray sensor 102, in-bed 
state sensor 103, air quality sensor 104, toilet sensor 
1 05, and PIT 1 1 1 , and the detection data of each is input 
to the specifying unit 131 shown in FIG. 12. In addition, 
20 information on the person carrying the PIT 1 1 1 , specified 
by the transmitter/receiver 112, is also input to the spec- 
ifying unit 131. 

[021 5] July 22 window 1 1 9 and 1 20 opening and clos- 
ing actions, TV 121 power on/off actions, and refrigera- 

25 tor 122 door opening and closing actions, are detected, 
respectively, by the window open/close detectors 106 
and 107, TV power on/off detector 108, and refrigerator 
door open/close detector 1 09, and the detection data of 
each is input to the specifying unit 131 . 

30 [021 6] On the basis of the various input detection da- 
ta, the specifying unit 131 specifies the exact behavior 
of the resident. This specified exact resident behavior is 
input to the second recording unit 135, where it is re- 
corded and stored temporarily. 

35 [0217] Next, the determining unit 132 determines 
whether the exact resident behavior specified by the 
specifying unit 131 is identical with the pattern recorded 
in the first recording unit 1 30 within a given time period 
or within a given range of behavior. Then, if the result of 

40 this determination is that the exact resident behavior is 
not identical with the pattern within a given time period 
or within a given range of behavior, the output unit 133 
outputs an alarm. 

[0218] To take an actual example for the purpose of 
45 explanation, it will be assumed, as with embodiment 3, 
that the resident visits the hospital on the same day each 
week starting from July 22, and that he/she leaves home 
at 9 a.m. to go to the hospital. The resident goes to the 
kitchen 114 at 8 a.m. and prepares breakfast, finishes 
50 breakfast at 8:30 a.m., and enters the living room 115. 
The resident opens and closes the refrigerator 122 in- 
termittently between 8 a.m. and 8:10 a.m., and watches 
TV 121 for ten minutes from 8:30. 
[0219] Based on the resident's behavior detected by 
55 the CCD camera 101a, etc., and the refrigerator 122 
door opening and closing actions detected by the refrig- 
erator door open/close detector 1 09, the specifying unit 
131 specifies the fact that the resident is "eating in the 
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kitchen" from 8 a.m. to 8:30 a.m., and based on the res- 
ident's behavior detected by the CCD camera 101b and 
detection data indicating that the TV 121 power is on 
detected by the TV power on/off detector 1 08, specifies 
the fact that the resident is "watching TV in the living 
room" from 8:30 to 8:40. 

[0220] In this case, the determining unit 132 deter- 
mines that the exact resident behavior specified by the 
specifying unit 131 is not identical with the pattern re- 
corded in the first recording unit 130. The output unit 
1 33 then outputs an alarm to the PIT 1 1 1 and the loud- 
speaker 113. The output unit 133 transmits the alarm to 
the PIT 111 by electric wave. When the PIT 111 receives 
the alarm by electric wave, it emits speech, vibration, 
and light on the basis of that alarm, notifying the resident 
of the alarm. The loudspeaker 113 also emits a warning 
sound. When warned in this way, the resident stops the 
alarm. 

[0221] The resident usually visits the hospital on the 
same day each week starting from July 22, and since 
the exact behavior on the day of the hospital visit differs 
from the pattern, it is assumed that the resident wishes 
to record the exact resident behavior on July 22 in the 
first recording unit 130 as a new pattern, In this case, 
the resident inputs an instruction to perform additional 
recording of the exact behavior of July 22 in the first re- 
cording unit 1 30 as a new pattern. The PIT 1 1 1 transmits 
the instruction received from the resident to the input 
unit 134 of the management unit 129 by electric wave, 
and the input unit 134 inputs the resident's instruction 
transmitted from the PIT 111 , and outputs it to the learn- 
ing unit 136. 

[0222] Now, since the second recording unit 1 35 tem- 
porarily records the exact resident behavior of July 22 
specified by the specifying unit 1 31 , as described above, 
the exact resident behavior temporarily recorded in the 
second recording unit 135 is additionally recorded by the 
learning unit 136 in the first recording unit 130 as part 
of a new pattern, based on the resident's instruction in- 
put by the input unit 134. The learning unit 136 also se- 
quentially records, in the first recording unit 1 30, the ex- 
act resident behavior of July 22 after the input unit 134 
has input the resident's instruction, as the remaining 
part of the new pattern. 

[0223] As the resident's response to an alarm is input 
to the input unit 1 34 in this way, and control is performed 
so that a new pattern is recorded in the first recording 
unit 130 on the basis of that response, an alarm is not 
issued even if the exact resident behavior on July 22 
after input of the response by the input unit 1 34, and the 
pattern, are not substantially identical, and an alarm is 
not issued if the resident shows substantially the same 
behavior as the July 22 behavior after the new pattern 
has been recorded in the first recording unit 130 or to 
be exact, from July 23 onward. 
[0224] The residents response input by the input unit 
1 34 may be an instruction to record the part of the exact 
behavior of July 22 from 8 a.m. to 1 p.m. in the first re- 



cording unit 130, replacing the part of the pattern from 
8 a.m. to 1 p.m. Also, the resident's response input by 
the input unit 134 may be an instruction to delete the 
pattern recorded in the first recording unit 130, and 

5 record the exact behavior of July 22 in the first recording 
unit 130 as a new pattern. In any case, the learning unit 
136 controls the operation of the first recording unit 130 
and the second recording unit 135 on the basis of the 
response input by the input unit 134. 

10 [0225] As explained above, the behavior determining 
apparatus of embodiment 4 outputs an alarm if a pattern 
recorded beforehand in the first recording unit 130, and 
the exact behavior of the subject person, are not sub- 
stantially identical, and the subject person's response 

15 to that alarm can be input. Also, based on that response, 
exact behavior of the subject person that is not substan- 
tially identical to the pattern is additionally recorded in 
the first recording unit 130 as a new pattern, or recorded 
in the first recording unit 130, replacing some or all of 

20 the pattern already recorded in the first recording unit 
130. 

[0226] The first recording unit 130 of the above de- 
scribed embodiment 4 only needs to record one or a plu- 
rality of the resident's exact behavior patterns. And the 

25 determining unit 132 only needs to determine whether 
or not any of the one or plurality of patterns recorded by 
the first recording unit 130 is substantially identical to 
the exact behavior specified by the specifying unit 131 . 
[0227] Therefore, if the exact behavior of the subject 

30 person in a given time period, recorded in the first re- 
cording unit 130, is a pattern of lying quietly in bed with- 
out music being played, but the subject person is actu- 
ally in bed with the audio system left on during that time, 
the specifying unit 131 specifies "in bed with the audio 

35 system left on" as the exact behavior of the subject per- 
son, and so the exact behavior of the subject person will 
not be identical to the pattern. In this case an alarm will 
be issued, but if the subject person went to bed leaving 
the audio system on in order to sleep deeply, rather than 

40 forgetting to turn the audio system off, and, in response 
to that alarm, wishes to record in the first recording unit 
130 exact behavior of sleeping with the audio system 
left on, and inputs information to that effect to the input 
unit 134, the exact behavior "sleeping with the audio 

45 system left on" will be recorded in the first recording unit 
130 as an addition or update. 
[0228] in the above described embodiment 4, the 
specifying unit 131 specifies the exact behavior of the 
subject person based on the detected behavior of the 

so subject person and detected device actions; however, 
the specifying unit 131 may also specify the exact be- 
havior of the subject person based on the detected be- 
havior of the subject person, detected device actions, 
and the detected physiological state and/or psycholog- 

55 ical state of the subject person. 

[0229] In this case, the pattern recorded in the first 
recording unit 130 must be a pattern based on the sub- 
ject person's behavior, device actions, and the subject 
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person's physiological state and/or psychological state. 
Also, detecting means for detecting the physiological 
state and/or psychological state of the subject person 
must be provided. The means for detecting the physio- 
logical state and/or psychological state of the subject 
person was described in embodiment 3, so that descrip- 
tion will be omitted here. In this case, too, the determin- 
ing unit 1 32 determines whether or not the exact behav- 
ior of the subject person specified by the specifying unit 
131 is substantially identical to any of the patterns re- 
corded in the first recording unit 130. 
[0230] Also, some or all of the component elements 
of the behavior determining apparatus of the above de- 
scribed embodiment 4 may be hardware, or may be soft- 
ware with the same functions as the corresponding func- 
tions of that hardware. 

(Embodiment 5) 

[0231] Next > the configuration of a care system ac- 
cording to embodiment 5 will be described using FIGS. 
7 and 14. 

[0232] FIG. 7 is a drawing for explaining the location 
of each component unit when the several component 
units configuring the behavior determining apparatus of 
the above described embodiment 3 are installed in var- 
ious locations in a residence, etc. As explained later, 
some of the component units configuring the care sys- 
tem of embodiment 5 are the same as some of the com- 
ponent units configuring the behavior determining ap- 
paratus of embodiment 3, and therefore FIG. 7 will also 
be used when describing the care system of embodi- 
ment 5. FIG. 14 is a block diagram of the care system 
of embodiment 5. 

[0233] As shown in FIG. 14, the care system of em- 
bodiment 5 is configured by CCD cameras 101a and 
1 01 b, an infrared ray sensor 1 02, an in-bed state sensor 
1 03, an air quality sensor 1 04, a toilet sensor 1 05, win- 
dow open/close detectors 1 06 and 1 07, a TV power on/ 
off detector 1 08, a refrigerator door open/close detector 
109, a management unit 137, a PIT 111 , a transmitter/ 
receiver 1 1 2, and a loudspeaker 113. The CCD cameras 
101a and 101b, infrared ray sensor 102, in-bed state 
sensor 103, air quality sensor 104, toilet sensor 105, 
window open/close detectors 106 and 107, TV power 
on/off detector 108, refrigerator door open/close detec- 
tor 109, PIT 111, transmitter/receiver 112, and loud- 
speaker 113 are the same as the relevant component 
units configuring the behavior determining apparatus of 
embodiment 3 described using FIGS. 7 and 8. 
[0234] The management unit 137 is installed within a 
wall of the living room 1 15 in FIG. 3, in the same way as 
the management unit 110 of the behavior determining 
apparatus of embodiment 3, and, as shown in FIG. 14, 
is configured by an specifying unit 138, an output unit 
139, an input unit 140, an information providing unit 141 , 
and a control unit 142. 

[0235] The specifying unit 1 38 is means for specifying 



the exact behavior of the resident on the basis of detect- 
ed resident behavior and detected device actions. The 
behavior of the resident is detected by means of the 
CCD cameras 101a and 1 01 b, infrared ray sensor 1 02, 

5 in-bed state sensor 103, air quality sensor 104, toilet 
sensor 105, and PIT 111 , and information, etc., received 
by the transmitter/receiver 112 is also used for resident 
behavior detection. Device actions, on the other hand, 
mean opening and closing actions for the windows 119 

io and 120 provided in the bedroom 116 and living room 
115 in FIG. 7, power on/off actions for the TV 121 located 
in the living room 115, and opening and closing actions 
for the door of the refrigerator 1 22 located in the kitchen 
114, and these actions are detected, respectively, by the 

15 window open/close detector 106, window open/dose 
detector 1 07, TV power on/off detector 1 08, and refrig- 
erator door open/close detector 109. 
[0236] The output unit 1 39 is means for outputting the 
exact behavior of the resident specified by the specify- 

20 jng unit 138. The input unit 140 is means for inputting 
the resident's response to information output by the out- 
put unit 139. The information providing unit 141 has 
many items of information relating to the care of the res- 
ident set, and is means for selecting one or a plurality 

25 of information items from the many information items 
set, on the basis of the resident's responses input to the 
input unit 140, and providing that selected information. 
This selected information is output from the loudspeaker 
113. An actual example of care-related information will 

30 be described when the operation of the care system of 
embodiment 5 is explained later. The control unit 142 is 
means for controlling the operation of devices located 
in the resident's residence on the basis of the resident's 
responses input to the input unit 140, and is connected 

35 by cables to the devices subject to control. In embodi- 
ment 5, the window 120 provided in the living room 115 
is used as an example of a device subject to control. 
[0237] In embodiment 5, the CCD cameras 1 01 a and 
101b, infrared ray sensor 102, in-bed state sensor 103, 

40 air quality sensor 104, toilet sensor 105, PIT 111 , and 
transmitter/receiver 112 are used as an example of the 
first detecting means of the care systems. Also, in em- 
bodiment 5, the window open/close detectors 106 and 
1 07, TV power on/off detector 1 08, and refrigerator door 

45 open/close detector 1 09 are used as an example of the 
second detecting means of the care system. 
[0238] In embodiment 5, the specifying unit 1 38 within 
the management unit 137 is used as an example of the 
specifying means, and the output unit 139 within the 

so management unit 137, PIT 111, loudspeaker 113 are 
used as an example of the notifying means, and the in- 
put unit 140 is used as an example of the input means, 
respectively, of the care system. 
[0239] In embodiment 5, the information providing 

55 unit 141 within the management unit 137 is used as an 
example of the information providing means of the care 
system, and the control unit 142 within the management 
unit 137 is used as an example of the control means of 
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the care system. 

[0240] Next, the operation of the care system accord- 
ing to embodiment 5 will be described. 
[0241 ] As described in embodiment 3, the CCD cam- 
eras 101a and 101b, infrared ray sensor 102, in-bed 
state sensor 103, air quality sensor 104, toilet sensor 
1 05, and PIT 1 1 1 detect the behavior of the subject res- 
ident, and output the various detection data to the spec- 
ifying unit 1 38 within the management unit 1 37. Also, as 
described in embodiment 3, the transmitter/receiver 1 1 2 
outputs information on the person carrying the specified 
PIT 111 to the specifying unit 138. The window open/ 
close detectors 106 and 107, TV power on/off detector 
108, and refrigerator door open/close detector 109 de- 
tect, respectively, window 119 and 120 opening and 
closing actions, TV 121 power on/off actions, and refrig- 
erator 1 22 door opening and closing actions, and output 
the respective detection data to the specifying unit 138. 
[0242] The specifying unit 1 38 specifies the exact be- 
havior of the resident on the basis of the input resident 
behavior detection data and device action detection da- 
ta. For example, if the resident is detected to be in the 
living room 1 1 5 for a long time by the CCD camera 101b, 
and during the time in which that resident is detected to 
be in the living room 115, the power of the TV 121 is 
detected to be on by the TV power on/off detector 1 08, 
the specifying unit 138 specifies thefact that the resident 
has been watching TV for a long time in the living room 
115. 

[0243] The output unit 1 39 outputs the exact behavior 
of the resident, specified by the specifying unit 138, to 
the PIT 111 and loudspeaker 113. The output unit 139 
transmits information to the PIT 111 by electric wave. 
When the PIT 1 1 1 receives information by electric wave, 
it outputs the exact resident behavior in speech form, 
based on that information. The loudspeaker 113, also, 
outputs the exact resident behavior in speech form, 
based on information from the output unit 139. To be 
specific, information to the effect that the resident "has 
been watching the TV 121 in the living room 115 for a 
long time" is output from the PIT 111 and loudspeaker 
113. 

[0244] When exact resident behavior is output from 
the PIT 111 and loudspeaker 113 in this way, that resi- 
dent can respond to the information output from the PIT 
111 and loudspeaker 113, and that response is input to 
the PIT 111. The PIT 111 transmits the response re- 
ceived from the resident to the input unit 1 40 within the 
management unit 137 by electric wave, and the input 
unit 140 inputs the resident's response transmitted from 
the PIT 111 , and outputs it to the information providing 
unit 141 and control unit 142. The information providing 
unit 141 then performs information provision on the ba- 
sis of the resident's response, and the control unit 142 
controls device actions on the basis of the resident's re- 
sponse. 

[0245] If, for example, the resident has been watching 
the TV 1 21 for a long time and wants to take some kind 



of exercise, and the resident's response is a query as 
to what kind of exercise should be taken, the information 
providing unit 141 will provide an exercise menu on the 
basis of that response. This exercise menu is output 

5 from the loudspeaker 113. Information to be provided is . 
set in the information providing unit 1 41 , and an example 
of this set information is an exercise menu. There may 
be, for example, a plurality of exercise menus applicable 
to the case where the resident has not taken any exer- 

w cise for a long time, and if the resident's response in- 
cludes information on the length of time for which exer- 
cise has not been taken, the information providing unit 

141 will select a suitable menu from among a plurality 
of menus, on the basis of that length of time without tak- 

'5 ing exercise, and provide that menu. 

[0246] And if, for example, the resident has been 
watching the TV 121 for a long time and decides that 
the ventilation of the living room 115 is inadequate, and 
the resident's response is to effect control so that the 

20 window 120 is opened for ten minutes, the control unit 

142 will control window 120 opening/closing actions so 
that the window 120 is opened for ten minutes. If the 
resident's response is a request to have cheerful music 
played and to have sunlight let into the living room 115, 

25 the control unit 1 42 will control audio system and curtain 
opening/closing actions. 

[0247] If the resident does not respond, the exact res- 
ident behavior specified by the specifying unit 138 can 
be notified to family members, etc., living apart from the 
30 resident, by means of a loudspeaker in the resident's 
residence or in a residence other than that of the resi- 
dent, connected via a telephone line, etc., to the care 
system of embodiment 5. 

[0248] In the above described embodiments, the care 

35 system has been described taking the example of the 
case where the specifying unit 138 specifies the fact that 
the resident has been watching the TV 121 in the living 
room 115 for a long time, on the basis of input resident 
behavior detection data and device action detection da- 

40 ta. The specifying means of the care system is means 
for specifying the exact behavior of the resident, on the 
basis of input resident behavior detection data and de- 
vice action detection data, in this way. 
[0249] If, for example, the specifying unit 138 speci- 

45 fjes the fact that the audio system is on when the resi- 
dent has gone to bed, information to that effect is noti- 
fied; and if the resident's response to that information is 
a request for the audio system volume to be gradually 
reduced and for the audio system to be turned off after 

so 30 minutes, the control unit 1 42 will control the operation 
of the audio system on the basis of that response. If the 
resident does not respond, the control unit 142 could 
also turn the audio system off immediately. 
[0250] And if, for example, the specifying unit 138 

55 specifies the fact that 8 hours has elapsed since the res- 
ident went to bed, and it is time for the resident to get 
up, information to that effect is notified; and if the resi- 
dent's response to that notification is for the curtains to 
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be opened, the control unit 1 42 will open the closed cur- 
tains on the basis of that response. If, on the other hand, 
the resident still feels sleepy and gives a response for 
the curtain opening time to be put back by 30 minutes, 
the control unit 142 will open the closed curtains after 
the elapse of the requested 30 minutes, on the basis of 
that response. And if, for example, the resident has a 
headache and feels unwell, and gives a response to 
have that fact notified to a resident other than the subject 
resident, or to family members, for instance, by means 
of a loudspeaker installedin the residence of those fam- 
ily members, the control unit 142 will notify information 
to the effect that the resident is unwell, on the basis of 
that response. 

[0251] Also, if, for example, the specifying unit 138 
specifies the fact that the resident is almost motionless 
in the toilet, information to that effect is notified. If this 
kind of situation occurs a given number of times, and in 
each case the resident responds to the notification by 
indicating that there is nothing wrong, it would also be 
possible for the specifying unit 138, from the next time 
on, to notify the relevant information only if the resident 
is almost motionless in the toilet for longer than a given 
time. 

[0252] Also, if, for example, the specifying unit 138 
specifies the fact that the resident is napping on the sofa, 
information to that effect, or information to that effect and 
the information "You will catch cold," is notified, and the 
resident gives a response indicating "Understood" to 
that notification, or if the indoor environment has not 
changed but the resident responds with a request to 
have the lights turned down, the control unit 1 42 will turn 
down the room lights on the basis of that response. And 
if it is notified that the resident is napping on the sofa, 
and a response requesting that the lights be turned 
down is received more than a given number of times, 
the lights could be turned down, from the next time on, 
when the resident is specified as napping on the sofa, 
without issuing a notification to that effect. 
[0253] Thus far, it has been assumed that the speci- 
fying unit 138 specifies the exact behavior of the resi- 
dent on the basis of input resident behavior detection 
data and device action detection data, but it is also pos- 
sible for detection data whereby the physiological state 
and/or psychological state of the resident are specified 
also to be input, and the behavior of the resident to be 
accurately specified. In this case, a third detecting 
means is necessary to enable the physiological state 
and/or psychological state of the resident to be speci- 
fied, and the detecting means for detecting the physio- 
logical state and/or psychological state of the resident 
described in embodiment 3 can be used as this third de- 
tecting means. 

[0254] If the specifying unit 138 finds, for example, 
that the resident tends to stay indoors and, according to 
the results of psychological tests, is found to suffer from 
mental stress, information to this effect is notified, and 
if the resident responds to this notification with a re- 



sponse for having the operation of the audio system 
controlled to output soothing music, or a response for 
performing control in order to increase the indoor neg- 
ative ion count, the control unit 142 will control the op- 

s eration of the stereo set, or perform air conditioner con- 
trol, on the basis of that response. 
[0255] Some or all of the component elements of the 
above described care system of embodiment 5 may be 
hardware, or may be software with the same functions 

10 as the corresponding functions of that hardware. 

(Embodiment 6) 

[0256] Next, the configuration of a behavior informa- 
15 tion specifying apparatus according to embodiment 6 

will be described with reference to the drawings. FIG. 

15 is an outline configuration diagram of the behavior 

information specifying apparatus in one embodiment. 

This embodiment is configured by an RF-ID 202, moving 
20 direction detector 205, and position specifying unit 206, 

as sensors. 

[0257] The RF-ID 202 is configured by a tag 203 at- 
tached to a human body 201 , an antenna 204 that re- 
ceives an electric wave of a specific frequency transmit- 

25 ted from that tag 203, and a sensor signal processor 207 
that processes signals obtained from the tag 203. 
[0258] The moving direction detector 205 is a device 
that uses infrared ray sensors, distance sensors, etc., 
and performs sensor output according to the direction 

30 of motion of a human body or inanimate object, proc- 
esses sensor signals output from the moving direction 
detector 205 by means of the sensor signal processor 
207, and determines the direction of movement-enter- 
ing or leaving a room-of a human body or inanimate ob- 

35 ject. 

[0259] The position specifying unit 206 is a device that 
specifies the position of a human body or inanimate ob- 
ject by means of image extraction from a CCD camera, 
an infrared ray sensorcapable of measuring two-dimen- 

40 sional temperature distribution, or an infrared camera, 
or from the intensity and direction of an electric wave 
from an electric wave generator attached to a human 
body or inanimate object, using one or more antennas 
installed indoors, and that processes signals obtained 

45 from the antenna by means of the sensor signal proc- 
essor 207, and can calculate two-dimensional coordi- 
nates on an indoor floor. 

[0260] The operation in this embodiment will be de- 
scribed below. The RF-ID antenna 204 and moving di- 

50 rection detector 205 are installed near an entrance/exit, 
and the position specifying unit 206 is installed in the 
room. The antenna 204 of the RF-ID 202 is in a state of 
constant standby for reception of electric waves from the 
tag 203. When a human body with a tag 203 attached 

55 to some part approaches the entrance/exit, the antenna 
204 receives the specific frequency of the tag 203. This 
is the provisional specification state. 
[0261] Next, when the human body moves from out- 
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side the room to inside the room, the moving direction 
detector 205 detects the movement of the human body, 
and the full specification state is established when the 
human body has completely entered the room. After 
specification is completed, the positions of the human 
body and inanimate objects are specified using the po- 
sition specifying unit 206. Processing for collecting and 
determining these signals is performed by the sensor 
signal processor 207. 

(Embodiment 7) 

[0262] Next, the configuration of a behavior informa- 
tion specifying apparatus according to embodiment 7 
will be described with reference to the drawings. FIG. 

1 6 shows an outline type drawing of the behavior infor- 
mation specifying apparatus in one embodiment. FIG. 

17 shows the ID specification procedure using the mov- 
ing direction detector in one embodiment. The operation 
and method in this embodiment will be described below 
for the case where a human body moves from a pas- 
sageway into a room. 

[0263] In FIG. 1 6, a human body 201 is about to enter 
a room carrying a tag 203 on part of the body. As the 
entrance/exit is approached, the moving direction de- 
tector 205 detects the human body, and confirms the 
beginning of passage through the entrance/exit (S201). 
At this point, the RF-ID antenna 204 starts receiving the 
specific frequency of the tag 203 (5202). If entry into the 
room is continued further, the tag 203 advances into the 
reception range of the antenna 204, and so the ID elec- 
tric wave is received (S203). This is the provisional 
specification state (S204). 

[0264] If entry into the room is continued further, and 
the moving direction detector 205 confirms that passage 
through the entrance/exit has been completed (S205), 
the full specification state is established (S206), after 
which, unless the room is exited, a standby state is es- 
tablished for information reception from each sensor for 
the specified ID (S207). Here, the position specifying 
unit 206 performs human body and inanimate object po- 
sition specification for the number of specified IDs. 
[0265] If movement is made from the provisional 
specification state to the passageway without entering 
the room, for example, since the moving direction de- 
tector 205 has not confirmed completion of passage, the 
full specification state will not be entered. 
[0266] On the other hand, the procedure is also as de- 
scribed above when a human body 201 leaves the room. 
First, as the entrance/exit is approached, the moving di- 
rection detector 205 detects the human body, and con- 
firms the beginning of passage through the entrance/ 
exit. At this point, the RF-ID antenna 204 starts receiving 
the specific frequency of the tag 203. Also, if egress from 
the room is continued further, the tag 203 advances into 
the reception range of the antenna 204, and so the ID 
electric wave is received. This is the provisional speci- 
fication state. If egress from the room is continued fur- 



ther, and the moving direction detector 205 confirms that 
passage through the entrance/exit has been completed, 
the full specification state is established, after which, un- 
less the room is entered, information reception from 
5 each sensor for the specified IDiscanceled. Sincethere 
is no specified ID, the position specifying unit 206 does 
not perform position specification. 

(Embodiment 8) 

10 

[0267] Next, the operation of the moving direction de- 
tector 205 in a behavior information specifying appara- 
tus according to embodiment 8 will be described with 
reference to the drawings. FIG. 18 shows the installation 

15 position and detection area of the moving direction de- 
tector 205 in the behavior information specifying appa- 
ratus in one embodiment, viewed from ceiling to floor. 
[0268] The moving direction detector 205 is installed 
in the end of one wall. An infrared ray sensor is used as 

20 the moving direction detector 205 in this embodiment, 
configured so that the three zones A, B, and C in the 
drawing are simultaneously detected by the respective 
elements. As this sensor outputs sensor output corre- 
sponding to the radiant temperature of the detected 

25 body, the sensor output is given a binary characteristic 
by means of a threshold value to distinguish between 
the presence of a human body within the sensor's de- 
tection range and the state in which nothing is present 
(background). 

30 [0269] FIG. 1 9 shows an example of motion detection 
by the moving direction detector 205. In FIG. 19, the 
squares are binary results, with black indicating the 
presence of a human body and white indicating the 
background. The horizontal direction shows the direc- 

35 tion of the sensor detection areas, and the vertical di- 
rection shows the flow of time. 
[0270] The method of detecting the passage of a hu- 
man body in this embodiment will be described below. 
When a human body begins to enter a room from out- 

40 side, in the same way as described in embodiment 7, 
the body passes through sensor detection areas A, B, 
and C, in that order, so that the time-series data resulting 
from binary processing of the sensor output is as shown 
in FIG. 19 (1). When a human body moves from inside 

45 the room to outside the room, on the other hand, the 
body passes through sensor detection areas C, B, and 
A, in that order, so that the time-series data resulting 
from binary processing of the sensor output is as shown 
in FIG. 19(2). 

so [0271] FIG. 19 (3) shows the case where a human 
body begins to move from outside to inside the room, 
passing from area A into area B, and arriving beneath 
the antenna 204, but does not enter the room. In this 
case, since the body does not enter area C, the provi- 

55 sional specification state is held, and the full specifica- 
tion state is not established. If the hold time for the pro- 
visional specification state is set beforehand, the provi- 
sional specification state will also be cleared. 
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[0272] FIG. 19 (4) shows the case where a human 
body stops near the entrance/exit; in this case, too, the 
provisional specification state is established, as de- 
scribed before, but the full specification state is not. Al- 
so-although a drawing is not used for the description 
here-for cases where two or more persons enter a room 
in succession, for example, accuracy can be improved 
by making the detection areas narrower. And cases 
where two persons leave the room simultaneously, or 
where the entrance/exit is wide, can be handled by in- 
stalling a plurality of sensors. 
[0273] By using an infrared ray sensor for the moving 
direction detector in this way, entry into and egress from 
a room can be accurately specified, and the RF-ID tag 
reception timing can also be pinpointed with extreme ac- 
curacy, enabling greater specification accuracy to be 
achieved. Here, an example of an infrared ray sensor 
has been given, but this is not a limitation, and in cases 
where a sensor employing light or ultrasonic waves is 
used, also, similar results can be obtained by binary rep- 
resentation ofthepresenceornon-presenceofahuman 
body. 

(Embodiment 9) 

[0274] Next, a behavior information specifying appa- 
ratus according to embodiment 9 will be described with 
reference to the drawings. FIG. 20 shows an outline type 
drawing of the behavior information specifying appara- 
tus in one embodiment. Inside the room, antennas for 
measuring electric wave intensity 21 0 which receive an 
electric wave of a specific frequency are installed in the 
fourcorners of the room, and these are connected to an 
electric wave intensity analyzer 208. 
[0275] A personal portable terminal 250 is attached to 
part of a human body 201 . When the human body 201 
enters the room, a transmitter incorporated in the per- 
sonal portable terminal 250 transmits an electric wave 
of a specific frequency. This electric wave is received by 
the antennas for measuring electric wave intensity 21 0, 
the intensity ratio of this electric wave is analyzed by the 
electric wave intensity analyzer 208, and the position of 
the human body 201 in the room is calculated. 

(Embodiment 10) 

[0276] The actual human body position specification 
method of the behavior information specifying appara- 
tus described in embodiment 9 will now be described 
with reference to the drawings. Two examples will be 
described for this embodiment. 
[0277] FIG. 21 shows measurement example 1 re- 
garding the human body position specification method. 
The upper drawing in FIG. 21 shows a room viewed from 
above. The antenna 21 0 installed at the top of corner A 
of the room can measure electric wave intensity and di- 
rectivity, and with regard to electric wave directivity, can 
measure ±x degrees. An example of the measurement 



of the intensity and directivity of an electric wave of a 
specific frequency transmitted from the transmitter in- 
corporated in the personal portable terminal 250 de- 
scribed in embodiment 9 is shown in the lower drawing 

5 in FIG. 21 . As there is a correlation between the electric 
wave intensity and the distance between the antenna 
and the transmitter, in this measurement example, from 
the peak value of the electric wave intensity and the di- 
rectivity angle, it appears that a human body is present 

10 at the position indicated by a star shown in the upper 
part of FIG. 21 . In this measurement example, the an- 
tenna 21 0 must be provided with a function for measur- 
ing the directivity of the electric wave, which involves a 
certain cost. 

15 [0278] A position specification method will now be de- 
scribed in which electric wave intensity is measured us- 
ing a plurality of antennas. FIG. 22 shows this measure- 
ment example 2. In this measurement example, the in- 
tensity of the electric wave of a specific frequency trans- 

20 mitted from the transmitter incorporated in the personal 
portable terminal 250 is measured by antennas installed 
at the top of room corners A, B, C, and D. The reception 
intensity of the electric wave received by each antenna 
enables the distance from the respective corner to be 

25 calculated, based on the correlation between the elec- 
tric wave intensity found beforehand and the distance 
between the antenna and the transmitter. The place 
where circles drawn with the respective comers as their 
centers overlap is the position of the transmitter, and in 

30 the measurement example it appears that a human 
body is present at the position indicated by a star. 
[0279] In the two examples above, the cases of one 
antenna and four antennas are described, but the 
number of antennas is not limited to these numbers. Al- 

35 so, it goes without saying that the accuracy of position 
specification can be improved by increasing the number 
of antennas. 

(Embodiment 11) 

40 

[0280] The position specifying unit in the behavior in- 
formation specifying apparatus according to embodi- 
ment 11 will now be described with reference to the 
drawings. FIG. 23 shows outline type drawings relating 

45 to the position specifying unit using a two-dimensional 
infrared ray sensor in the behavior information specify- 
ing apparatus in one embodiment. 
[0281 ] The field of view of the infrared ray sensor at- 
tached to the ceiling is shown viewed from the side in 

50 the upper drawing in FIG. 23, and viewed from above in 
the lower drawing. A chopper is fitted to the front of a 
pyro-electric one-dimensional array element provided 
with a plurality of photo-receptors, and when the rotated 
in the circumferential direction shown in the lower draw- 

55 jng in FIG. 23, the field of view is also divided in the cir- 
cumferential direction according to the chopping timing, 
and it is possible to measure the two-dimensional tem- 
perature distribution within the room as shown in the 
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drawing. In this implementation example, there are six 
photo-receptors, and so there are six divisions in the ra- 
dial direction and 24 divisions in the circumferential di- 
rection. Since the temperature of the measured body 
can easily be calculated on the basis of the chopper tem- 
perature, it is possible to set a suitable sensor output 
threshold and extract the area in which a human body 
is present. Also, since the apparent size of a human 
body is determined by the distance from the sensor, it 
is possible to distinguish between the area of the tem- 
perature in the vicinity of a human body, and the area of 
a human body, and to increase the accuracy of human 
body extraction. 

[0282] By means of the above method, it is possible 
to find the position at which a human body is present in 
a room as on-floor coordinates. This method is not lim- 
ited to the case where a two-dimensional infrared ray 
sensor is used; it is possible to extract a human body 
area in the same way, and obtain similar results, by di- 
viding a thermal image obtained from a two-dimensional 
infrared camera. 

[0283] As opposed to the above described case, in 
which the two-dimensional temperature distribution is 
measured using an infrared ray sensor, and a human 
body extracted, a method will now be described for 
measuring a visible image using a CCD camera, and 
extracting a human body. (Drawings are not used in this 
description.) A, plurality of CCD cameras are installed 
in the upper part of a room, with a field of view in the 
direction of the floor, and a visible image is measured. 
Extraction of a human body area is performed using a 
method such as moving body contour extraction or facial 
skin color extraction. Also, since the apparent size of a 
human body is determined by the distance from the 
cameras, the accuracy of human body extraction can be 
increased. Correlational data for positions within the 
field of view of the cameras and actual on-floor positions 
can be measured or found by calculation beforehand, 
and the actual position at which a human body is present 
can be found from a human body image extracted within 
the field of view of the cameras. 

(Embodiment 12) 

[0284] The position specifying unit in the behavior in- 
formation specifying apparatus according to embodi- 
ment 12 will now be described with reference to the 
drawings. FIG. 24 shows an outline type drawing of the 
behavior information specifying apparatus in one em- 
bodiment. At the entrance/exit, a human body 201 for 
which entry into the room has been confirmed by the 
moving direction detector 205 undergoes ID detection 
by the antenna 204 of the RF-ID 202. After entry into the 
room, position specification is performed by the position 
specifying unit 206, at which time the ID information and 
position information are aggregated in the sensor signal 
processor 207, enabling information as to "who" is 
"where" to be obtained 



[0285] In case of a plurality of persons, also, by 
changing the specific frequency from the personal port- 
able terminal 250 described in embodiment 1 0 for indi- 
vidual persons, it is possible to obtain the respective hu- 

5 man body position information effectively. Since ID 
specification is performed at the entrance/exit in both 
case of a single person and the case of a plurality of 
persons, even if the electric wave transmitted by a per- 
sonal portable terminal 250 should happen to be re- 

10 ceived by a unit in the next room, since ID specification 
. has not been performed in the next room, incorrect de- 
tection will never occur. 

(Embodiment 13) 

15 

[0286] The state specifying unitin the behavior infor- 
mation specifying apparatus according to embodiment 

1 3 will now be described with reference to the drawings. 
FIG. 25 shows an outline type drawing of the behavior 

20 information specifying apparatus in one embodiment. 
[0287] The state specifying unit 209 in the personal 
portable terminal 250 attached to a human body 201 is 
configured by one or more sensors, measures informa- 
tion on the state of the human body such as attitude, 

25 walking condition (walking horizontally, climbing stairs, 
descending stairs), activity state (resting, normal activ- 
ity, vigorous activity), and physiological state (heart rate, 
blood pressure, body temperature, perspiration)-and 
transmits this to the sensor signal processor 207 via a 

30 transmitter 212. 

[0288] In this implementation example, there are no 
particular restrictions on the place where sensor output 
is analyzed. That is to say, it is possible to complete sen- 
sor outputanalysis by the state specifying unit 209 in the 

35 personal portable terminal 250 and obtain various kinds 
of human body state information, or it is possiblefor sen- 
sor raw output to be transmitted first to the sensor signal 
processor 207 from the transmitter 212, and then for 
analysis to be performed by the sensor signal processor 

40 207, and various kinds of human body state information 
to be obtained. Moreover, the state specifying unit 209 
and the transmitter 212 may be incorporated in the 
above described personal portable terminal 250. 

45 (Embodiment 14) 

[0289] The state specifying unitin the behavior infor- 
mation specifying apparatus according to embodiment 

14 will now be described. In this embodiment, the state 
so specifying unit 209 in the personal portable terminal 250 

and transmitter 212 are incorporated in the personal 
portable terminal 250. In the same way as described in 
embodiment 12, at the entrance/exit a human body 201 
that has undergone ID detection by the RF-ID 202 and 
55 moving direction detector 205 is confirmed to have en- 
tered the room. 

[0290] After entry into the room, human body state de- 
tection is performed by the state specifying unit 209 , and 
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that information is transmitted to the sensor signal proc- 
essor 207. At this time, ID information is also communi- 
cated to the sensor signal processor 207, and informa- 
tion exchange is performed, enabling information as to 
"who" is doing "what" "where" to be obtained. 
[0291] In case of a plurality of persons, also, by 
changing the specific frequency from the personal port- 
able terminal 250 described in embodiment 10 for indi- 
vidual persons, it is possible to obtain the respective hu- 
man body position information effectively, and it is also 
possible to add individual state information. 
[0292] Since ID specification is performed at the en- 
trance/exit in both case of a single person and case of 
a plurality of persons, even if the electric wave transmit- 
ted from the transmitter should happen to be received 
by a unit in the next room, since ID specification has not 
been performed in the next room, incorrect detection will 
never occur. 

(Embodiment 15) 

[0293] The state specifying unitin the behavior infor- 
mation specifying apparatus according to embodiment 
1 5 will now be described with reference to the drawings. 
FIG. 26 shows an outline type drawing of the state spec- 
ifying unitin one embodiment. 
[0294] This device is fixed to a part of the body using 
a belt around the waist, etc. In this embodiment, the at- 
titude, walking condition, line of movement, etc., can be 
detected using an acceleration sensor 216 and a rate 
gyro 217. Regarding attitude, the tri-axial gravitational 
force components of the acceleration sensor 216 are 
measured, and the inclination of the body is found. Re- 
garding the walking condition, the gravitational direction 
output of the acceleration sensor 21 6 is analyzed to de- 
termine whether the condition is stationary or walking, 
and if walking, whether climbing stairs or descending 
stairs. 

[0295] The rate gyro 217 is used to find the line of 
movement of a human body, in the same way as in a 
vehicle navigation system. The built-in sensor signals 
are analyzed by a signal processor 21 9 and transmitted 
from an antenna 218 as various kinds of state informa- 
tion. 

[0296] An alarm buzzer 220 alerts the person to which 
the unit is attached if there is no movement of the body 
for a long time, for instance, and if there is no reaction, 
such as executing a reset, an abnormal state signal is 
transmitted from the antenna 218. When this abnormal 
state signal is received, action can be taken to check 
the well-being of the person, or an outside party can be 
notified. 

[0297] In this embodiment, a combination of acceler- 
ation sensor and rate gyro has been described, it is also 
possible, for example, to capture attitude information 
with an angle-of-inclination sensor. 
[0298] It is alsopossible to capture information from 
an external sensor via a sensor interface for an optional 



sensor 221 . For example, it is possible for a body tem- 
perature sensor using a heart rate sensor and temper- 
ature sensor, and a perspiration sensor using a humidity 
sensor, to be incorporated within a watch-type sensor 

5 unit, worn on the wrist, and so capture the above de- 
scribed sensor information from the sensor interface for 
an optional sensor 221 . In this case, either capture by 
cable or capture by wireless is, of course, possible. Also, 
there are no particular restrictions on where the state 

w specifying unitis attached, as long as it is somewhere 
on the body. 

(Embodiment 16) 

is [0299] Network connection with the behavior informa- 
tion specifying apparatus according to embodiment 16 
will now be described with reference to the drawings. 
FIGS. 27 and 28 show outline type drawings of the be- 
havior state specifying unitin one embodiment. The be- 

20 havior information specifying apparatus described up to 
embodiment 15 is connected to a base station 213 via 
the sensor signal processor 207. These base stations 
213 are installed in individual rooms. 
[0300] This base station 213 and another base station 

25 214, installed in a different room, are connected in a net- 
work, and are further connected to a central station 215. 
By means of this kind of network connection, the infor- 
mation of each room can all be shared, and the state of 
all rooms can also be ascertained at the central station. 

30 |f a display device such as a monitor is installed in the 
central station, the state of individual rooms can be 
seen. This can greatly ease the burden, not only on the 
family, but also on the nursing staff at facilities for taking 
care of seniorcitizens, and so forth. In this implementa- 

35 tion example, nothing in particular has been said regard- 
ing the kind of network, and there are no particular re- 
strictions on this. 



40 Claims 

1 . A behavior determining apparatus, comprising: 

first detective means (1a, 1b, 2,3, 4, 5, 11, 12) 
45 for directly detecting the behavior of a given 

subject person; 

determining means (24); and 

so output means (25) for outputting a determined 

result of the said determining means (24) 

characterized by 

second detective means (6, 7, 8, 9) for detecting the 
55 operation of a given appliance; 

recording means (23) for recording one or more 
combined patterns of behavior of said subject per- 
son and operation of said appliance; 
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and in that said determining means (24) compares 
the behavior of said subject person detected by said 
first detective means (1a, 1b, 2, 3,4,5, 11, 12) and 
the operation of said appliance detected by said 
second detective means (6, 7, 8, 9) with patterns 
recorded in said recording means (23) to determine 
whether or not a combination of behavior of said 
subject person and operation of said appliance sub- 
stantially accords with any of said patterns. 

2. A behavior determining apparatus as set forth in 
claim 1 , further comprising: 

first transmitter/receiver means (12) for trans- 
mitting the radio wave for specifying said sub- 
ject person to a given space and receiving an 
information item by a radio wave; and 

second transmitter/receiver means (11) borne 
by said subject person for receiving the radio 
wave transmitted by said first transmitter/re- 
ceiver means (12) to transmit an ID number by 
a radio wave; wherein 

said first transmitter/receiver means (1 2) receives 
said ID number transmitted by said second trans- 
mitter/receiver means (11) and said first detective 
means (1a, 1b, 2, 3, 4, 5, 11, 12) can specify said 
subject person and can detect his or her behavior 
by using said ID number received by said first trans- 
mitter/receiver means (12). 

3. A behavior determining apparatus as set forth in 
claim 1 or 2, further comprising: 

alarm transmitter means (26) for transmitting 
an alarm by a radio wave in accordance with 
the determined result of said determining 
means (24); and 

alarm receiver means (11) borne by said sub- 
ject person for receiving said alarm by said ra- 
dio wave. 

4. A behavior determining apparatus as set forth in 
claim 1 or 2, further comprising: 

notifying means (27) for notifying an alarm by 
an audio or optical signal in accordance with 
the determined result of said determining 
means (24) to the residential space where said 
subject person behaves. 

5. A behavior determining apparatus as set forth in 
claim 1 or 2, further comprising: 

notifying means (27) for notifying an alarm by 
using a telephone line, an electric light line or a 



private line in accordance with the result deter- 
mined by said determining means (24) to out- 
side of the residential space where said subject 
person behaves. 

5 

6. A behavior determining apparatus as set forth in 
claim 1 or 2, further comprising: 

third detective means (11) for detecting the 
10 physiological state of said subject person and/ 

or the psychological state of said subject per- 
son, wherein 

said pattern is a combined pattern of behavior 
15 of said subject person, operation of said appli- 

ance and physiological state of said subject 
person and/or psychological state of said sub- 
ject person, and 

20 said determining means (24) compares the be- 

havior of said subject person, the operation of 
said appliance and the physiological state of 
said subject person and/or the psychological 
state of said subject person with patterns re- 

25 corded in the recording means (23) to deter- 

mine whether a combination of behavior of said 
subject person, operation of said appliance and 
physiological state of said subject person and/ 
or the psychological state of said subject per- 

30 son substantially accords with any of said pat- 

terns or not. 

7. A behavior determining apparatus as set forth in 
claim 6, wherein said third detective means (1 1 ) can 

35 specify said subject person by using said ID number 
received by said first transmitter/receiver means 
(12) and can detect the physiological state of said 
subject person and/or the psychological state of 
said subject person. 

40 

8. A behavior determining apparatus as set forth in 
claim 1 or 2, further comprising: 

a PIT (personal information terminal) (11) borne 
45 by said subject person, capable of transmitting/ 

receiving a given information, 

wherein said PIT (11) has all or part of the functions 
of said first detective means (1a, 1b, 2, 3, 4, 5, 11, 
so 12) and said second transmitter/receiver means 
(11). 

9. A behavior determining apparatus as set forth in 
claim 8, wherein said PIT (1 1 ) has all or part of the 

55 functions for detecting the posture, the moving con- 
dition and the active mass of said subject person 
bearing it. 
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10 



15 



10. A behavior determining apparatus as set forth in 
claim 2, further comprising: 

a PIT (personal information terminal) (1 1 ) borne 
by said subject person, having the function of 
said second transmitter/receiver means (11) 
and capable of transmitting/receiving a given 
information item, 

wherein said first transmitter/receiver means (12), 
provided substantially at the adjoining part of adja- 
cent rooms in a residence or substantially at the ad- 
joining part between a given room in said residence 
and the adjacent corridor, specifies the subject per- 
son bearing said PIT (11) in moving one from an- 
other of said adjacent rooms or in moving one from 
another of said adjacent room and corridor by using 
said ID number transmitted by said PIT (11). 

11. A behavior determining apparatus as set forth in 
claim 8, wherein transmitting/receiving an informa- 
tion item of said PIT (11) is performed in the com- 
munication shape of a PHS system or in the com- 
munication shape of a specific small electric power 
using a frequency zone of several hundred MHz. 

12. A behaviour determining method, comprising fol- 
lowing steps: 



directly detecting the behavior of a given sub- so 
ject person; and 

outputting a determined result, 



20 



25 



eine Bestimmungseinrichtung (24); und 

eine Ausgabeeinrichtung (25), die ein Bestim- 
mungsergebnis der Bestimmungseinrichtung 
(24) ausgibt, 

gekennzeichnet durch: 

zweite Erfassungseinrichtungen (2), die die 
Funktion eines bestimmten Gerates erfassen; 

eine Aufzeichnungseinrichtung (23), die eines 
oder mehrere kombinierte Verhaltensmuster 
der Objekt-Person und der Funktion des Gera- 
tes aufzeichnet; 

und dadurch, dass die Bestimmungseinrich- 
tung (24) das Verhalten der Objekt-Person, das 
durch die ersten Erfassungseinrichtungen (1) 
erfasst wird, und die Funktion des Gerates, die 
durch die zweite Erfassungseinrichtung (2) er- 
fasst wird, mit Mustern vergleicht, die in der 
Aufzeichnungseinrichtung (23) aufgezeichnet 
sind, urn zu bestimmen, ob eine Kombination 
aus dem Verhalten der Objekt-Person und der 
Funktion des Gerates im Wesentlichen mit ei- 
nem der Muster ubereinstimmt. 



characterized by the steps of 
detecting the operation of a given appliance, re- 
cording one or more combined patterns of behavior 
of said subject person and operation of said appli- 
ance comparing the detected behavior of said sub- 
ject person and the detected operation of said ap- 
pliance with recorded patterns to determine wheth- 
er or not a combination of behavior of said subject 
person and operation of said appliance substantial- 
ly accords with any of said patterns. 

13. A computer readable medium having a computer 
program embodied thereon, the computer program 
being adapted to carry out all steps of claim 12. 



Patentansprtiche 

1 . Verhaltens-Bestimmungsvorrichtung, die umf asst: 

erste Erfassungseinrichtungen (1), die direkt 
das Verhalten einer bestimmten Objekt-Person 
erfassen; 



35 
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Verhaltens-Bestimmungsvorrichtung 
spruch 1 , die des Weiteren umfasst: 



nach An- 



eine erste Sender-/Empfangereinrichtung (12), 
die die Funkwelle zum Bestimmen der Objekt- 
Person in einem bestimmten Raum sendet und 
ein Informationselement uber eine Funkwelle 
empfangt; und 

eine zweite SenderVEmpfangereinrichtung 
(11), die von der Objekt-Person getragen wird, 
urn die durch die erste SenderVEmpfangerein- 
richtung (12) gesendete Funkwelle zu empfan- 
gen und eine Kennungsnummer uber eine 
Funkwelle zu senden; wobei 

die erste Sender-/Empfangereinrichtung (12) 
die Kennungsnummer empfangt, die durch die 
zweite Sender-/Empfangereinrichtung (11) ge- 
sendet wird, und die ersten Erfassungseinrich- 
tungen (1) die Objekt-Person bestimmen und 
ihr Verhalten unterVerwendung der Kennungs- 
nummer erfassen konnen, die durch die erste 
Sender-/Empfangereinrichtung (12) empfan- 
gen wird. 



55 3. 



Verhaltens-Bestimmungsvorrichtung nach 
spruch 1 oder 2, die des Weiteren umfasst: 



An- 



eine Alarm-Sendeeinrichtung (26), die einen 



67 



EP 1 071 055 B1 



68 



Alarm uber eine Funkwelle entsprechend dem 
Bestimmungsergebnis der Bestimmungsein- 
richtung (24) sendet; und 

eine Alarm-Empfangereinrichtung (1 1 ), die von 
der Objekt-Person getragen wird, urn den 
Alarm uber die Funkwelle zu empfangen. 

4. Verhaltens-Bestimmungsvorrichtung nach An- 
spruch 1 oder 2, die des Weiteren umfasst: 

eine Meldungseinrichtung (27), die einen Alarm 
durch ein Ton- oder Lichtsignal entsprechend 
dem Bestimmungsergebnis der Bestimmungs- 
einrichtung (24) in den Wohnraum meldet, in 
dem sich die Objekt-Person verhalt. 

5. Verhaltens-Bestimmungsvorrichtung nach An- 
spruch 1 oder 2, die des Weiteren umfasst: 

eine Meldungseinrichtung (27), die einen Alarm 
unter Verwendung einer Telefonleitung, einer 
elektrischen Lichtleitung oder einer Standlei- 
tung entsprechend dem durch die Bestim- 
mungseinrichtung (24) bestimmten Ergebnis in 
dem Wohnraum, in dem sich die Objekt-Person 
verhalt, nach auBen meldet. 

6. Verhaltens-Bestimmungsvorrichtung nach An- 
spruch 1 oder 2, die des Weiteren umfasst: 

eine dritte Erfassungseinrichtung (11), die den 
physiologischen Zustand der Objekt-Person 
und/oder den psychologischen Zustand der 
Objekt-Person erfasst, 

wobei 

das Muster ein kombiniertes Muster aus dem Ver- 
halten der Objekt-Person, der Funktion des Gera- 
tes und dem physiologischen Zustand der Objekt- 
Person und/oder dem psychologischen Zustand 
der Objekt-Person 1st, und 
die Bestimmungseinrichtung (24) das Verhalten der 
Objekt-Person, die Funktion des Gerates und den 
physiologischen Zustand der Objekt-Person und/ 
oder den psychologischen Zustand der Objekt-Per- 
son mit Mustern vergleicht, die in der Aufzeich- 
nungseinrichtung (23) aufgezeichnet sind, urn zu 
bestimmen, ob eine Kombination aus dem Verhal- 
ten der Objekt-Person, der Funktion des Gerates 
und des physiologischen Zustandes der Objekt- 
Person und/oder des psychologischen Zustandes 
der Objekt-Person im Wesentlichen mit einem der 
Muster ubereinstimmt oder nicht 

7. Verhaltens-Bestimmungsvorrichtung nach An- 
spruch 6, wobei die dritte Erfassungseinrichtung 
(11) die Objekt-Person unter Verwendung der Ken- 



nungsnummer identifizieren kann, die durch die er- 
ste Sender-/Empfangereinrichtung(12) empfangen 
wird, und den physiologischen Zustand der Objekt- 
Person und/oder den psychologischen Zustand der 
s Objekt-Person erfassen kann. 

8. Verhaltens-Bestimmungsvorrichtung nach An- 
spmch 1 oder 2, die des Weiteren umfasst: 

10 ein personliches Informations-Endgerat (per- 

sonal information terminal - PIT) (11), das von 
der Objekt-Person getragen wird und in der La- 
ge ist, eine bestimmte Information zu senden/ 
empfangen, 

15 

wobei das PIT (11) alle oder einen Teil der Funktio- 
nen der ersten Erfassungseinrichtungen (1 ) und der 
zweiten SenderVEmpfangereinrichtung (11) hat. 

20 9. Verhaltens-Bestimmungsvorrichtung nach An- 
spruch 8, wobei das PIT (11) uber alle oder einen 
Teil der Funktionen zum Erfassen der Haltung, der 
Bewegungsrichtung und der aktiven Masse der Ob- 
jekt-Person, die es tragt, verfugt. 

25 

10. Verhaltens-Bestimmungsvorrichtung nach An- 
spruch 2, die des Weiteren umfasst: 

ein PIT (11), das von der Objekt-Person getra- 
30 . gen wird, das uber die Funktion der zweiten 

SenderVEmpfangereinrichtung (11) verfugt 
und in der Lage ist, ein bestimmtes informati- 
onselement zu senden/empfangen, 

35 wobei die erste Sender-/Empfangereinrichtung 
(12), die im Wesentlichen an dem angrenzenden 
Teil benachbarter Raume in einem Wohngebaude 
oder im Wesentlichen an dem angrenzenden Teil 
zwischen einem bestimmten Raum in dem Wohn- 

40 gebaude und dem benachbarten Korridor vorhan- 
den ist, die Objekt-Person, die das PIT (11) tragt, 
bei Bewegung zwischen einem und einem anderen 
der benachbarten Raume oder bei Bewegung zwi- 
schen einem der benachbarten Raume und dem 

45 Korridor unter Verwendung der Kennungsnummer 
identifiziert, die durch das PIT (11) gesendet wird. 

11. Verhaltens-Bestimmungsvorrichtung nach An- 
spruch 8, wobei Senden/Empfangen eines Informa- 

so tionselementes des PIT (11) in der Kommunikati- 
onsform eines PHS-Systems oder in der Kommuni- 
kationsfomn einer bestimmten geringen elektri- 
schen Leistung unter Verwendung eines Frequenz- 
bereiches von mehreren hundert MHz durchgefuhrt 

55 wird. 

12. Verhaltens-Bestimmungsverfahren, dasdiefolgen- 
den Schritte umfasst: 
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direktes Erfassen des Verhaltens einer be- 
stimmten Objekt-Person; und 

Ausgeben eines bestimmten Ergebnisses, 

gekennzelchnet durch die folgenden Schritte: 

Erfassen der Funktion eines bestimmten Gera- 
tes, Aufzeichnen eines Oder mehrerer kombi- 
nierter Muster des Verhaltens der Objekt-Per- 
son und der Funktion des Gerates, Vergleichen 
des erfassten Verhaltens der Objekt-Person 
und der erfassten Funktion des Gerates mit 
aufgezeichneten Mustern, urn zu bestimmen, 
ob eine Kombination aus dem Verhalten der 
Objekt-Person und der Funktion des Gerates 
im Wesentlichen mit einem der Muster uberein- 
stimmt. 

13. Computeriesbares Medium mit einem darauf umge- 
setzten Computerprogramm, wobei das Computer- 
programm zum Ausfuhren aller Schritte nach An- 
spruch 12 eingerichtet ist. 



Revendications 

1. Dispositif de 
comprenant : 



determination de comportement, 



un premier moyen de detection (1 a, 1b, 2, 3, 4, 
5, 11, 12) destine k detecter directement le 
comportement d'une personne sujet donn6e, 
un moyen de determination (24), et 
un moyen de sortie (25) destine k foumir en sor- 
tie un resultat determine dudit moyen de deter- 
mination (24) 

caracterise par 

un second moyen de detection (6, 7, 8, 9) des- 
tine k detecter le fonctionnement d'un appareil don- 
ne, 

un moyen d'enregistrement (23) destine k en- 
registrer un ou plusieurs profils combines de com- 
portement de ladite personne sujet et du fonction- 
nement dudit appareil, 

et en ce que ledit moyen de determination 
(24) compare le comportement de ladite personne 
sujet detecte par ledit premier moyen de detection 
(1a, 1b, 2, 3, 4, 5, 11, 12) et le fonctionnement dudit 
appareil detecte par ledit second moyen de detec- 
tion (6, 7, 8, 9), a des profils etant enregistres dans 
ledit moyen d'enregistrement (23) afin de determi- 
ner si unecombinaison d'un comportement de ladi- 
te personne sujet et d'un fonctionnement dudit ap- 
pareil s'accorde sensiblement ou non avec Pun 
quelconque desdits profils. 



2. Dispositif de determination de comportement selon 
la revendication 1 , comprenant en outre : 

un premier moyen demission/reception (12) 
5 destine k transmettre I'onde radio destinee k 

specifier ladite personne sujet k un espace 
donne et k recevoir un element d'information 
par une onde radio, et 

un second moyen d'emission/reception (11) 
10 porte par ladite personne sujet destine k rece- 

voir I'onde radio emise par ledit premier moyen 
d'emission/reception (12) afin de transmettre 
un numero ^identification par une onde radio, 
ou : 

15 

ledit premier moyen d'emission/reception 
(12) regoit ledit numero ^identification 
transmis par ledit second moyen d'emis- 
sion/reception (11) et ledit premier moyen 
20 de detection (1 a, 1 b, 2, 3, 4, 5, 1 1 , 1 2) peut 

specifier ladite personne sujet et peut de- 
tecter son comportement en utilisant ledit 
numero d'identification re$u par ledit pre- 
mier moyen d'emission/reception (12). 

25 

3. Dispositif de determination de comportement selon 
la revendication 1 ou 2, comprenant en outre : 

un moyen d'emission d'alarme (26) destine k 
30 emettre une alarme par une onde radio confor- 

mement au resultat determine par ledit moyen 

de determination (24), et 

un moyen de reception d'alarme (11) porte par 

ladite personne sujet destine k recevoir ladite 
35 alarme grace k ladite onde radio. 

4. Dispositif de determination de comportement selon 
la revendication 1 ou 2, comprenant en outre : 

40 un moyen de notification (27) destine k notifier 

u ne alarme par un signal audio ou optique con- 
formement au resultat determine par ledit 
moyen de determination (24) k I'espace resi- 
dentiel ou ladite personne sujet 6volue. 



50 



45 

5. Dispositif de determination de comportement selon 
la revendication 1 ou 2, comprenant en outre : 

un moyen de notification (27) destine k notifier 
une alarme en utilisant une ligneteiephonique, 
une ligne de courant eiectrique ou bien une li- 
gne privee conformement au r6sultat determi- 
ne par ledit moyen de determination (24) k I'ex- 
terieur de I'espace residentiel ou ladite person- 
55 ne sujet evolue. 

6. Dispositif de determination de comportement selon 
la revendication 1 ou 2, comprenant en outre : 
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un troisfeme moyen de detection (11 ) destine k 
detecter I'etat physiologique de ladite personne 
sujet et/ou I'etat psychologique de ladite per- 
sonne sujet, ou ledit profil est un profil combine 
de comportement de ladite personne sujet, du 
fonctionnement dudit appareil et de I'etat phy- 
siologique de ladite personne sujet et/ou de 
I'etat psychologique de ladite personne sujet, et 
ledit moyen de determination (24) compare le 
comportement de ladite personne sujet, le 
fonctionnement dudit appareil et I'etat physio- 
logique de ladite personne sujet et/ou I'etat psy- 
chologique de ladite personne sujet aux profils 
enregistres dans le moyen d'enregistrement 
(23) afin de determiner si une combinaison de 
comportement de ladite personne sujet, du 
fonctionnement dudit appareil et de I'etat phy- 
siologique de ladite personne sujet et/ou de 
I'etat psychologique de ladite personne sujet 
s'accorde ou non pour I'essentiel avec I'un 
quelconque desdits profils. 

7. Dispositif de determination de comportement selon 
la revendication 6, dans lequel ledit troisfeme 
moyen de detection (11) peut specifier ladite per- 
sonne sujet en utilisant ledit num6ro d'identification 
regu par ledit premier moyen demission/reception 
(12) et peut detecter I'etat physiologique de ladite 
personne sujet et/ou I'etat psychologique de ladite 
personne sujet. 

8. Dispositif de determination de comportement selon 
la revendication 1 ou 2, comprenant en outre : 

un terminal d'informations personnelles (PIT) 
(11) porte par ladite personne sujet, capable 
d'emettre/recevoir des informations donnees, 

dans lequel ledit terminal d'informations per- 
sonnelles (11) presente tout ou partie des fonctions 
dudit premier moyen de detection (1a, 1b, 2, 3, 4, 
5, 1 1 , 1 2) et dudit second moyen d'emission/recep- 
tion (11). 



ment d'information donn6, 

dans lequel ledit premier moyen d'emission/ 
reception (12) dispose pratiquement k la partie de 

5 jonction de pieces adjacentes dans une residence 
ou pratiquement k la partie de jonction entre une 
piece donnee dans ladite residence et le couloir ad- 
jacente, specifie la personne sujet portant ledit ter- 
minal d'informations personnelles (11) lorsqu'elle 

10 se deplace de Tune dans I'autre desdites pieces ad- 
jacentes ou bien lorsqu'elle se deplace depuis Tune 
de ladite piece et dudit couloir adjacents dans 
I'autre en utilisant ledit numero d'identification 
transmis par ledit terminal d'informations person- 

is nelles (11). 

1 1 . Dispositif de determination de comportement selon 
la revendication 8, dans lequel remission/reception 
d'un element d'information dudit terminal d'informa- 

20 tions personnelles (1 1 ) est executee sous la forme 
de communication d'un systeme PHS ou sous la 
forme de communication d'une petite tension eiec- 
trique sp£cifique utilisant une zone de f r6q uence de 
plusieurs centaines de megahertz. 

25 

12. Precede de determination de comportement, com- 
prenant les etapes suivantes : 

detecter directement le comportement d'une 
30 personne sujet donnee, et 

fournir en sortie un resultat determine, 

caracterise par les etapes consistant k 
detecter le fonctionnement d'un appareil don- 

35 ne, enregistrer un ou plusieurs profils combines de 
comportement de ladite personne sujet et du fonc- 
tionnement dudit appareil en comparant le compor- 
tement detecte de ladite personne sujet et le fonc- 
tionnement detecte dudit appareil a des profils en- 

40 registres pour determiner si une combinaison d'un 
comportement de ladite personne sujet et d'un fonc- 
tionnement dudit appareil s'accorde pratiquement 
ou non avec I'un quelconque desdits profils. 



9. Dispositif de determination de comportement selon 
la revendication 8, dans lequel ledit terminal d'infor- 
mations personnelles (11) presente tout ou partie 
des fonctions destin6es k detecter la posture, I'etat 
de mouvement et la masse active de ladite person- 
ne sujet qui le porte. 50 



13. Support lisible par unordinateurcomportantun pro- 
gramme informatique inscrit sur celui-ci, le pro- 
gramme informatique etant con?u pour executer 
toutes les etapes de la revendication 12. 



10. Dispositif de determination de comportement selon 
la revendication 2, comprenant en outre : 



un terminal d'informations personnelles (PIT) 55 
(11) porte par ladite personne sujet, pr6sentant 
la fonction du second moyen d'6mission/recep- 
tion (11) et capable d'emettre/recevoir un 6I6- 
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Fig. II 
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Fig. 17 
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Fig. 22 
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Fig. 26 




EP 1 071 055 B1 




EP 1 071 055 B1 




CO 



